2024-09-15T12:06:28.671 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T12:06:28.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T12:06:28.799 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905527 branch: wip-matanb-crimson-testing-59543 description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests_old_format} email: null first_in_suite: false job_id: '7905527' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-59543 ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-1 osd.1: crimson seastar cpu cores: 2-3 osd.2: crimson seastar cpu cores: 4-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_APP_NOT_ENABLED\) - is full \(reached quota - \(POOL_FULL\) sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: crimson sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 1236 sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNoRO9Se7iHsmdTmrOJZbIxgIgmJxMNs3bZxT2bTQIONOAm3jNGd5NnwDZHtvPPVwkzrVyXNbueC+6M6kvXOLus= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rbd/crimson/test_crimson_librbd.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_11:59:21 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T12:06:28.800 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-15T12:06:28.800 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-15T12:06:28.800 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T12:06:28.802 INFO:teuthology.task.internal:Checking packages... 2024-09-15T12:06:28.825 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '81fedcb3b484c843d22ffbc8d179cb567b7083b5' 2024-09-15T12:06:28.825 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T12:06:28.825 INFO:teuthology.packaging:ref: None 2024-09-15T12:06:28.825 INFO:teuthology.packaging:tag: None 2024-09-15T12:06:28.825 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-59543 2024-09-15T12:06:28.825 INFO:teuthology.packaging:sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:06:28.825 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-59543 2024-09-15T12:06:28.971 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4879.g81fedcb3 2024-09-15T12:06:28.972 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T12:06:28.979 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T12:06:28.979 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T12:06:29.025 INFO:teuthology.task.internal:Saving configuration 2024-09-15T12:06:29.038 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T12:06:29.052 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T12:06:29.076 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905527', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 12:00:38.100639', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNoRO9Se7iHsmdTmrOJZbIxgIgmJxMNs3bZxT2bTQIONOAm3jNGd5NnwDZHtvPPVwkzrVyXNbueC+6M6kvXOLus='} 2024-09-15T12:06:29.076 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T12:06:29.103 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-09-15T12:06:29.103 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T12:06:29.161 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f87a44abbe0>, signals=[15]) 2024-09-15T12:06:29.161 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T12:06:29.168 INFO:teuthology.task.internal:Opening connections... 2024-09-15T12:06:29.168 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2024-09-15T12:06:29.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:06:29.244 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T12:06:29.251 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-09-15T12:06:29.321 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-09-15T12:06:29.321 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-09-15T12:06:29.378 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-09-15T12:06:29.378 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-09-15T12:06:29.378 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-09-15T12:06:29.378 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-09-15T12:06:29.378 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-09-15T12:06:29.378 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-09-15T12:06:29.378 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T12:06:29.379 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-09-15T12:06:29.379 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-09-15T12:06:29.379 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T12:06:29.379 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-09-15T12:06:29.379 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T12:06:29.379 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T12:06:29.379 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T12:06:29.379 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-09-15T12:06:29.403 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T12:06:29.412 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T12:06:29.459 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T12:06:29.459 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2024-09-15T12:06:29.474 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T12:06:29.484 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T12:06:29.484 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2024-09-15T12:06:29.618 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T12:06:29.659 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T12:06:29.673 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-15T12:06:29.673 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-15T12:06:29.673 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T12:06:29.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:06:29.689 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-09-15T12:06:29.745 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-503.el9.x86_64 2024-09-15T12:06:29.746 INFO:teuthology.task.kernel:Running kernel on smithi092: 5.14.0-503.el9.x86_64 2024-09-15T12:06:29.746 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2024-09-15T12:06:32.648 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 7.2 MB/s | 8.2 MB 00:01 2024-09-15T12:06:35.868 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-09-15T12:06:40.599 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 6.5 MB 00:00 2024-09-15T12:06:42.183 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 19 kB 00:00 2024-09-15T12:06:43.220 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-15T12:06:48.584 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-15T12:06:50.590 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T12:06:50.590 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T12:06:50.688 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:06:50.697 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:06:50.697 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-15T12:06:50.697 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:06:50.698 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:06:50.698 INFO:teuthology.orchestra.run.smithi092.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T12:06:50.698 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-15T12:06:50.698 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T12:06:50.698 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T12:06:50.698 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T12:06:50.698 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:06:50.698 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:06:50.698 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:06:50.698 INFO:teuthology.orchestra.run.smithi092.stdout:Install 4 Packages 2024-09-15T12:06:50.698 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:06:50.699 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 79 M 2024-09-15T12:06:50.699 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 126 M 2024-09-15T12:06:50.699 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:06:51.060 INFO:teuthology.orchestra.run.smithi092.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 273 kB/s | 23 kB 00:00 2024-09-15T12:06:51.435 INFO:teuthology.orchestra.run.smithi092.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-15T12:06:51.852 INFO:teuthology.orchestra.run.smithi092.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 39 MB/s | 35 MB 00:00 2024-09-15T12:06:52.160 INFO:teuthology.orchestra.run.smithi092.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-15T12:06:52.161 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:06:52.161 INFO:teuthology.orchestra.run.smithi092.stdout:Total 54 MB/s | 79 MB 00:01 2024-09-15T12:06:52.844 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:06:53.203 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:06:53.203 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:06:54.170 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:06:54.170 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:06:56.657 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:06:57.294 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T12:06:57.377 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:07:00.174 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:07:00.298 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:07:05.180 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:07:05.289 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:07:10.184 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:07:48.035 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:07:48.075 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:07:48.467 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:07:48.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T12:07:48.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:07:48.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:07:49.293 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:07:49.294 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:07:49.294 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:07:49.294 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T12:07:49.294 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T12:07:49.294 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T12:07:49.294 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T12:07:49.294 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:07:49.294 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:07:49.603 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T12:07:49.681 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T12:07:49.681 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T12:07:49.682 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T12:07:49.682 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T12:07:49.682 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T12:07:49.682 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-15T12:07:49.682 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi092.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T12:07:49.683 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T12:07:49.741 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T12:07:49.741 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T12:07:49.742 DEBUG:teuthology.orchestra.run.smithi092:> sudo rpm -qi grub2-tools 2024-09-15T12:07:49.782 INFO:teuthology.orchestra.run.smithi092.stdout:Name : grub2-tools 2024-09-15T12:07:49.782 INFO:teuthology.orchestra.run.smithi092.stdout:Epoch : 1 2024-09-15T12:07:49.782 INFO:teuthology.orchestra.run.smithi092.stdout:Version : 2.06 2024-09-15T12:07:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:Release : 82.el9 2024-09-15T12:07:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:Architecture: x86_64 2024-09-15T12:07:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T12:07:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:Group : Unspecified 2024-09-15T12:07:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:Size : 8274670 2024-09-15T12:07:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:License : GPLv3+ 2024-09-15T12:07:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T12:07:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T12:07:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T12:07:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T12:07:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:Packager : builder@centos.org 2024-09-15T12:07:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:Vendor : CentOS 2024-09-15T12:07:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T12:07:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:Summary : Support tools for GRUB. 2024-09-15T12:07:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:Description : 2024-09-15T12:07:49.784 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:07:49.784 INFO:teuthology.orchestra.run.smithi092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T12:07:49.784 INFO:teuthology.orchestra.run.smithi092.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T12:07:49.784 INFO:teuthology.orchestra.run.smithi092.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T12:07:49.784 INFO:teuthology.orchestra.run.smithi092.stdout:hardware devices. 2024-09-15T12:07:49.784 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:07:49.784 INFO:teuthology.orchestra.run.smithi092.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T12:07:49.785 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T12:07:49.785 INFO:teuthology.task.kernel:Updating grub on smithi092 to boot 5.14.0-505.el9.x86_64 2024-09-15T12:07:49.785 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T12:07:50.490 INFO:teuthology.orchestra.run.smithi092.stderr:Generating grub configuration file ... 2024-09-15T12:07:51.781 INFO:teuthology.orchestra.run.smithi092.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T12:07:51.821 INFO:teuthology.orchestra.run.smithi092.stderr:done 2024-09-15T12:07:51.823 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2024-09-15T12:07:51.839 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.3sEI2nPSa9 2024-09-15T12:07:51.839 DEBUG:teuthology.orchestra.run.smithi092:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.3sEI2nPSa9 2024-09-15T12:07:51.906 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.3sEI2nPSa9 2024-09-15T12:07:52.045 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.3sEI2nPSa9 is 6KB 2024-09-15T12:07:52.094 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.3sEI2nPSa9 2024-09-15T12:07:52.109 DEBUG:teuthology.orchestra.run.smithi092:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T12:07:52.171 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T12:07:52.171 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T12:07:52.171 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T12:07:52.171 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T12:07:52.172 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T12:07:52.322 DEBUG:teuthology.orchestra.run.smithi092:> sudo shutdown -r now 2024-09-15T12:08:22.353 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-15T12:08:22.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-15T12:08:22.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:08:40.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-09-15T12:08:49.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-15T12:08:49.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:08:52.833 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-09-15T12:09:04.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-15T12:09:04.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:09:23.261 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-09-15T12:09:38.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-15T12:09:38.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:09:38.727 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-09-15T12:09:39.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-15T12:09:39.165 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-15T12:09:39.165 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-09-15T12:09:39.179 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-505.el9.x86_64 2024-09-15T12:09:39.179 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T12:09:39.179 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T12:09:39.180 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T12:09:40.180 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-15T12:09:40.180 DEBUG:teuthology.orchestra.run.smithi092:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T12:09:40.305 INFO:teuthology.orchestra.run.smithi092.stdout:ttyS1 2024-09-15T12:09:40.327 DEBUG:teuthology.parallel:result is None 2024-09-15T12:09:40.327 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T12:09:40.333 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T12:09:40.334 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T12:09:40.349 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T12:09:40.356 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T12:09:40.387 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T12:09:40.387 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T12:09:40.450 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T12:09:40.458 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T12:09:40.458 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T12:09:40.651 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T12:09:40.662 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T12:09:40.663 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T12:09:40.671 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T12:09:40.671 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T12:09:40.696 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T12:09:40.704 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T12:09:40.705 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T12:09:40.752 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T12:09:40.857 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T12:09:40.940 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T12:09:40.994 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T12:09:41.069 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:09:41.069 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T12:09:41.131 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2024-09-15T12:09:41.270 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T12:09:41.802 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T12:09:41.811 INFO:teuthology.task.internal:Starting timer... 2024-09-15T12:09:41.811 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T12:09:41.845 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T12:09:41.874 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-15T12:09:41.874 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2024-09-15T12:09:41.914 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2024-09-15T12:09:41.916 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T12:09:41.916 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2024-09-15T12:09:41.983 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2024-09-15T12:09:41.983 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi092.front.sepia.ceph.com': 'permissive'} 2024-09-15T12:09:41.983 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T12:09:42.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:09:42.048 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T12:09:42.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2024-09-15T12:09:42.120 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T12:09:42.134 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T12:09:42.146 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T12:09:42.147 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi092.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T12:13:42.691 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi092.front.sepia.ceph.com')] 2024-09-15T12:13:42.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-15T12:13:42.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:13:42.850 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-09-15T12:13:42.879 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-15T12:13:42.880 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T12:13:42.896 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T12:13:42.896 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T12:13:42.897 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T12:13:42.954 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T12:13:42.966 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T12:13:42.989 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2024-09-15T12:13:43.003 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2024-09-15T12:13:43.014 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T12:13:43.029 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T12:13:43.089 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-09-15T12:13:43.090 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T12:13:43.090 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-09-15T12:13:43.090 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:13:43.090 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:13:43.091 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:13:43.091 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:13:43.091 INFO:teuthology.run_tasks:Running task install... 2024-09-15T12:13:43.101 DEBUG:teuthology.task.install:project ceph 2024-09-15T12:13:43.102 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}} 2024-09-15T12:13:43.102 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'} 2024-09-15T12:13:43.102 INFO:teuthology.task.install:Using flavor: crimson 2024-09-15T12:13:43.115 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T12:13:43.115 INFO:teuthology.task.install:extra packages: [] 2024-09-15T12:13:43.116 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-15T12:13:43.116 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:13:43.299 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-15T12:13:43.299 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-15T12:13:43.508 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T12:13:43.508 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:13:43.508 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T12:13:43.541 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-15T12:13:43.542 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T12:13:43.608 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T12:13:43.684 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T12:13:43.752 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2024-09-15T12:13:43.753 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2024-09-15T12:13:43.982 INFO:teuthology.orchestra.run.smithi092.stdout:45 files removed 2024-09-15T12:13:44.010 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw 2024-09-15T12:13:44.747 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 195 kB/s | 88 kB 00:00 2024-09-15T12:13:45.039 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-15T12:13:45.323 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 8.4 kB/s | 2.1 kB 00:00 2024-09-15T12:13:46.915 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.2 MB 00:01 2024-09-15T12:13:48.816 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-15T12:13:54.975 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-15T12:13:56.750 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-15T12:13:57.596 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-15T12:14:03.085 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-15T12:14:05.449 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:14:05.459 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:14:05.459 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-15T12:14:05.459 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:14:05.459 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:14:05.459 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-15T12:14:05.459 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2024-09-15T12:14:05.459 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-15T12:14:05.459 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-15T12:14:05.459 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-15T12:14:05.459 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T12:14:05.459 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-15T12:14:05.460 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-15T12:14:05.460 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-15T12:14:05.460 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T12:14:05.460 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T12:14:05.460 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T12:14:05.460 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-15T12:14:05.460 INFO:teuthology.orchestra.run.smithi092.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-15T12:14:05.460 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T12:14:05.460 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T12:14:05.460 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T12:14:05.460 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-15T12:14:05.460 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T12:14:05.461 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-15T12:14:05.461 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T12:14:05.461 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T12:14:05.461 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T12:14:05.461 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-15T12:14:05.461 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-15T12:14:05.461 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-15T12:14:05.461 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T12:14:05.461 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-15T12:14:05.461 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-15T12:14:05.461 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-15T12:14:05.461 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T12:14:05.461 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T12:14:05.461 INFO:teuthology.orchestra.run.smithi092.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T12:14:05.462 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T12:14:05.462 INFO:teuthology.orchestra.run.smithi092.stdout:Installing weak dependencies: 2024-09-15T12:14:05.462 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T12:14:05.462 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:14:05.462 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:14:05.462 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:14:05.462 INFO:teuthology.orchestra.run.smithi092.stdout:Install 31 Packages 2024-09-15T12:14:05.462 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 2 Packages 2024-09-15T12:14:05.462 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:14:05.463 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 60 M 2024-09-15T12:14:05.463 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:14:06.171 INFO:teuthology.orchestra.run.smithi092.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 10 MB/s | 6.1 MB 00:00 2024-09-15T12:14:06.313 INFO:teuthology.orchestra.run.smithi092.stdout:(2/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 14 MB/s | 10 MB 00:00 2024-09-15T12:14:06.341 INFO:teuthology.orchestra.run.smithi092.stdout:(3/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 150 kB/s | 25 kB 00:00 2024-09-15T12:14:06.372 INFO:teuthology.orchestra.run.smithi092.stdout:(4/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 14 MB/s | 809 kB 00:00 2024-09-15T12:14:06.405 INFO:teuthology.orchestra.run.smithi092.stdout:(5/33): libradosstriper1-19.3.0-4879.g81fedcb3. 8.1 MB/s | 558 kB 00:00 2024-09-15T12:14:06.472 INFO:teuthology.orchestra.run.smithi092.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 678 kB/s | 45 kB 00:00 2024-09-15T12:14:06.564 INFO:teuthology.orchestra.run.smithi092.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 1.5 MB/s | 143 kB 00:00 2024-09-15T12:14:06.639 INFO:teuthology.orchestra.run.smithi092.stdout:(8/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 20 MB/s | 5.4 MB 00:00 2024-09-15T12:14:06.665 INFO:teuthology.orchestra.run.smithi092.stdout:(9/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 1.6 MB/s | 160 kB 00:00 2024-09-15T12:14:06.690 INFO:teuthology.orchestra.run.smithi092.stdout:(10/33): python3-rados-19.3.0-4879.g81fedcb3.el 6.1 MB/s | 315 kB 00:00 2024-09-15T12:14:06.874 INFO:teuthology.orchestra.run.smithi092.stdout:(11/33): ceph-common-19.3.0-4879.g81fedcb3.el9. 15 MB/s | 20 MB 00:01 2024-09-15T12:14:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:(12/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 1.3 MB/s | 302 kB 00:00 2024-09-15T12:14:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:(13/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 425 kB/s | 99 kB 00:00 2024-09-15T12:14:07.007 INFO:teuthology.orchestra.run.smithi092.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 801 kB/s | 107 kB 00:00 2024-09-15T12:14:07.033 INFO:teuthology.orchestra.run.smithi092.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.2 MB/s | 171 kB 00:00 2024-09-15T12:14:07.075 INFO:teuthology.orchestra.run.smithi092.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-15T12:14:07.091 INFO:teuthology.orchestra.run.smithi092.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 540 kB/s | 45 kB 00:00 2024-09-15T12:14:07.133 INFO:teuthology.orchestra.run.smithi092.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-15T12:14:07.150 INFO:teuthology.orchestra.run.smithi092.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 719 kB/s | 42 kB 00:00 2024-09-15T12:14:07.176 INFO:teuthology.orchestra.run.smithi092.stdout:(20/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-15T12:14:07.209 INFO:teuthology.orchestra.run.smithi092.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-15T12:14:07.234 INFO:teuthology.orchestra.run.smithi092.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 428 kB/s | 36 kB 00:00 2024-09-15T12:14:07.260 INFO:teuthology.orchestra.run.smithi092.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-15T12:14:07.311 INFO:teuthology.orchestra.run.smithi092.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.0 MB/s | 308 kB 00:00 2024-09-15T12:14:07.335 INFO:teuthology.orchestra.run.smithi092.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-15T12:14:07.361 INFO:teuthology.orchestra.run.smithi092.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 300 kB/s | 26 kB 00:00 2024-09-15T12:14:07.386 INFO:teuthology.orchestra.run.smithi092.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-15T12:14:07.411 INFO:teuthology.orchestra.run.smithi092.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-15T12:14:07.461 INFO:teuthology.orchestra.run.smithi092.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-15T12:14:07.503 INFO:teuthology.orchestra.run.smithi092.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-15T12:14:07.579 INFO:teuthology.orchestra.run.smithi092.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-15T12:14:07.729 INFO:teuthology.orchestra.run.smithi092.stdout:(32/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 17 MB/s | 3.8 MB 00:00 2024-09-15T12:14:07.787 INFO:teuthology.orchestra.run.smithi092.stdout:(33/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 11 MB/s | 3.5 MB 00:00 2024-09-15T12:14:07.792 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:14:07.793 INFO:teuthology.orchestra.run.smithi092.stdout:Total 26 MB/s | 60 MB 00:02 2024-09-15T12:14:07.905 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:14:07.942 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:14:07.942 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:14:08.622 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:14:08.622 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:14:10.098 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:14:10.642 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-15T12:14:10.706 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:14:10.798 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:14:10.887 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-15T12:14:10.907 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:14:10.962 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:14:11.012 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-15T12:14:11.114 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-15T12:14:11.229 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-15T12:14:11.251 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-15T12:14:11.277 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-15T12:14:11.470 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-15T12:14:11.506 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-15T12:14:11.541 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-15T12:14:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-15T12:14:11.620 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-15T12:14:11.718 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-15T12:14:11.756 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-15T12:14:11.843 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-15T12:14:11.888 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-15T12:14:11.999 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-15T12:14:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-15T12:14:12.075 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-15T12:14:12.112 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-15T12:14:12.141 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-15T12:14:12.179 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-15T12:14:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-15T12:14:12.587 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-15T12:14:12.678 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-15T12:14:12.709 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-15T12:14:12.753 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-15T12:14:13.335 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-15T12:14:13.364 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-15T12:14:13.437 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-15T12:14:13.521 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-15T12:14:13.553 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-15T12:14:16.000 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:14:16.037 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:14:16.731 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:14:16.769 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-15T12:14:16.856 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-15T12:14:16.857 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T12:14:16.857 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T12:14:16.857 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:14:16.883 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:14:27.282 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:14:27.283 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2024-09-15T12:14:27.283 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2024-09-15T12:14:27.283 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2024-09-15T12:14:27.283 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2024-09-15T12:14:27.283 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2024-09-15T12:14:27.283 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /root 2024-09-15T12:14:27.283 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2024-09-15T12:14:27.283 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:14:28.415 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-15T12:14:28.441 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-15T12:14:28.441 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:14:28.441 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T12:14:28.441 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T12:14:28.441 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T12:14:28.441 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:14:28.442 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-15T12:14:28.526 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-15T12:14:28.526 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:14:29.912 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:14:29.912 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-15T12:14:29.912 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:14:29.912 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-15T12:14:29.912 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:14:29.912 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-15T12:14:29.912 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-15T12:14:29.912 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-15T12:14:29.913 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-15T12:14:29.913 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-15T12:14:29.913 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-15T12:14:29.913 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-15T12:14:29.913 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-15T12:14:29.913 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-15T12:14:29.913 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-15T12:14:29.913 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-15T12:14:29.913 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-15T12:14:29.913 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-15T12:14:29.913 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-15T12:14:29.913 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-15T12:14:29.914 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-15T12:14:29.914 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-15T12:14:29.914 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-15T12:14:29.914 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-15T12:14:29.914 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-15T12:14:29.914 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-15T12:14:29.914 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-15T12:14:29.914 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-15T12:14:29.914 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-15T12:14:29.914 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-15T12:14:29.915 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-15T12:14:29.915 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-15T12:14:29.915 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:14:29.915 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-15T12:14:29.915 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-15T12:14:30.857 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:14:30.857 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:14:30.857 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2024-09-15T12:14:30.857 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:30.857 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:30.857 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:14:30.857 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T12:14:30.858 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:30.858 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:30.858 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:30.858 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:30.858 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T12:14:30.858 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T12:14:30.858 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T12:14:30.858 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:30.858 INFO:teuthology.orchestra.run.smithi092.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-15T12:14:30.858 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T12:14:30.858 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T12:14:30.858 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T12:14:30.858 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:30.858 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T12:14:30.859 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:30.859 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T12:14:30.859 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T12:14:30.859 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T12:14:30.859 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:30.859 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:30.859 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:30.859 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T12:14:30.859 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:30.859 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:30.859 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:30.859 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T12:14:30.859 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T12:14:30.859 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T12:14:30.860 INFO:teuthology.orchestra.run.smithi092.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T12:14:30.860 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T12:14:30.860 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:14:30.860 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:14:31.220 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-test 2024-09-15T12:14:31.789 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:28 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:14:31.924 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:14:31.925 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:14:31.925 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-15T12:14:31.925 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:14:31.925 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:14:31.925 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-15T12:14:31.925 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-15T12:14:31.925 INFO:teuthology.orchestra.run.smithi092.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-15T12:14:31.925 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-15T12:14:31.926 INFO:teuthology.orchestra.run.smithi092.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-15T12:14:31.926 INFO:teuthology.orchestra.run.smithi092.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-15T12:14:31.926 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T12:14:31.926 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T12:14:31.926 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T12:14:31.926 INFO:teuthology.orchestra.run.smithi092.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-15T12:14:31.926 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:14:31.926 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:14:31.926 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:14:31.926 INFO:teuthology.orchestra.run.smithi092.stdout:Install 9 Packages 2024-09-15T12:14:31.926 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:14:31.927 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 87 M 2024-09-15T12:14:31.927 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 797 M 2024-09-15T12:14:31.927 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:14:32.388 INFO:teuthology.orchestra.run.smithi092.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 636 kB/s | 94 kB 00:00 2024-09-15T12:14:32.522 INFO:teuthology.orchestra.run.smithi092.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 3.8 MB/s | 513 kB 00:00 2024-09-15T12:14:32.588 INFO:teuthology.orchestra.run.smithi092.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 183 kB 00:00 2024-09-15T12:14:32.690 INFO:teuthology.orchestra.run.smithi092.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-15T12:14:32.772 INFO:teuthology.orchestra.run.smithi092.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-15T12:14:32.822 INFO:teuthology.orchestra.run.smithi092.stdout:(6/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 300 kB/s | 175 kB 00:00 2024-09-15T12:14:32.849 INFO:teuthology.orchestra.run.smithi092.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 846 kB/s | 64 kB 00:00 2024-09-15T12:14:32.889 INFO:teuthology.orchestra.run.smithi092.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.8 MB/s | 122 kB 00:00 2024-09-15T12:14:39.431 INFO:teuthology.orchestra.run.smithi092.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 12 MB/s | 85 MB 00:07 2024-09-15T12:14:39.434 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:14:39.434 INFO:teuthology.orchestra.run.smithi092.stdout:Total 12 MB/s | 87 MB 00:07 2024-09-15T12:14:39.518 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:14:39.540 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:14:39.540 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:14:40.166 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:14:40.166 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:14:41.054 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:14:41.138 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-15T12:14:41.184 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-15T12:14:41.236 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-15T12:14:41.262 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-15T12:14:41.301 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-15T12:14:41.326 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-15T12:14:41.399 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-15T12:14:41.443 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-15T12:14:41.469 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-15T12:14:52.728 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-15T12:14:52.800 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-15T12:14:58.959 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-15T12:14:58.959 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-15T12:14:58.959 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-15T12:14:58.959 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-15T12:14:58.959 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-15T12:14:58.959 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-15T12:14:58.959 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-15T12:14:58.959 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-15T12:14:58.959 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-15T12:14:59.350 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-15T12:14:59.351 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:14:59.351 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:14:59.351 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:59.351 INFO:teuthology.orchestra.run.smithi092.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-15T12:14:59.351 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:59.351 INFO:teuthology.orchestra.run.smithi092.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-15T12:14:59.351 INFO:teuthology.orchestra.run.smithi092.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-15T12:14:59.351 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T12:14:59.351 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T12:14:59.351 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T12:14:59.351 INFO:teuthology.orchestra.run.smithi092.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-15T12:14:59.351 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:14:59.351 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:14:59.675 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph 2024-09-15T12:15:00.243 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:57 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:15:00.383 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:15:00.385 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:15:00.385 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-15T12:15:00.385 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:15:00.385 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:15:00.386 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-15T12:15:00.386 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-15T12:15:00.386 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-15T12:15:00.386 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-15T12:15:00.386 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-15T12:15:00.386 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-15T12:15:00.386 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-15T12:15:00.386 INFO:teuthology.orchestra.run.smithi092.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T12:15:00.386 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T12:15:00.386 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T12:15:00.386 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T12:15:00.386 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T12:15:00.386 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T12:15:00.387 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T12:15:00.387 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T12:15:00.387 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T12:15:00.387 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T12:15:00.387 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections 2024-09-15T12:15:00.387 INFO:teuthology.orchestra.run.smithi092.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-15T12:15:00.387 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T12:15:00.387 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T12:15:00.387 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T12:15:00.387 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T12:15:00.387 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T12:15:00.387 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T12:15:00.388 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T12:15:00.388 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T12:15:00.388 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T12:15:00.388 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T12:15:00.388 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T12:15:00.388 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T12:15:00.388 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T12:15:00.388 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T12:15:00.388 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T12:15:00.388 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T12:15:00.388 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T12:15:00.388 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T12:15:00.389 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T12:15:00.389 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T12:15:00.389 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:00.389 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:15:00.389 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:15:00.389 INFO:teuthology.orchestra.run.smithi092.stdout:Install 37 Packages 2024-09-15T12:15:00.390 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:00.390 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 84 M 2024-09-15T12:15:00.390 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 897 M 2024-09-15T12:15:00.391 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:15:00.916 INFO:teuthology.orchestra.run.smithi092.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 24 kB/s | 6.5 kB 00:00 2024-09-15T12:15:01.791 INFO:teuthology.orchestra.run.smithi092.stdout:(2/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 1.4 MB/s | 1.6 MB 00:01 2024-09-15T12:15:01.925 INFO:teuthology.orchestra.run.smithi092.stdout:(3/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 1.7 MB/s | 2.2 MB 00:01 2024-09-15T12:15:02.025 INFO:teuthology.orchestra.run.smithi092.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 2.8 MB/s | 291 kB 00:00 2024-09-15T12:15:02.195 INFO:teuthology.orchestra.run.smithi092.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-15T12:15:02.312 INFO:teuthology.orchestra.run.smithi092.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 11 MB/s | 1.2 MB 00:00 2024-09-15T12:15:02.354 INFO:teuthology.orchestra.run.smithi092.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-15T12:15:02.413 INFO:teuthology.orchestra.run.smithi092.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-09-15T12:15:02.466 INFO:teuthology.orchestra.run.smithi092.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-15T12:15:02.538 INFO:teuthology.orchestra.run.smithi092.stdout:(10/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86 3.1 MB/s | 5.1 MB 00:01 2024-09-15T12:15:02.563 INFO:teuthology.orchestra.run.smithi092.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.1 MB/s | 215 kB 00:00 2024-09-15T12:15:02.705 INFO:teuthology.orchestra.run.smithi092.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-09-15T12:15:02.730 INFO:teuthology.orchestra.run.smithi092.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-15T12:15:02.747 INFO:teuthology.orchestra.run.smithi092.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 827 kB/s | 35 kB 00:00 2024-09-15T12:15:02.781 INFO:teuthology.orchestra.run.smithi092.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-15T12:15:02.798 INFO:teuthology.orchestra.run.smithi092.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-15T12:15:02.823 INFO:teuthology.orchestra.run.smithi092.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 994 kB/s | 42 kB 00:00 2024-09-15T12:15:02.865 INFO:teuthology.orchestra.run.smithi092.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-15T12:15:02.882 INFO:teuthology.orchestra.run.smithi092.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.6 MB/s | 43 kB 00:00 2024-09-15T12:15:02.915 INFO:teuthology.orchestra.run.smithi092.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 5.0 MB/s | 172 kB 00:00 2024-09-15T12:15:02.949 INFO:teuthology.orchestra.run.smithi092.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 10 MB/s | 358 kB 00:00 2024-09-15T12:15:02.974 INFO:teuthology.orchestra.run.smithi092.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 431 kB/s | 11 kB 00:00 2024-09-15T12:15:03.000 INFO:teuthology.orchestra.run.smithi092.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 704 kB/s | 18 kB 00:00 2024-09-15T12:15:03.025 INFO:teuthology.orchestra.run.smithi092.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 923 kB/s | 23 kB 00:00 2024-09-15T12:15:03.051 INFO:teuthology.orchestra.run.smithi092.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 781 kB/s | 19 kB 00:00 2024-09-15T12:15:03.076 INFO:teuthology.orchestra.run.smithi092.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 787 kB/s | 20 kB 00:00 2024-09-15T12:15:03.101 INFO:teuthology.orchestra.run.smithi092.stdout:(27/37): python3-logutils-0.3.5-21.el9.noarch.r 1.8 MB/s | 46 kB 00:00 2024-09-15T12:15:03.127 INFO:teuthology.orchestra.run.smithi092.stdout:(28/37): lua-devel-5.4.4-4.el9.x86_64.rpm 68 kB/s | 22 kB 00:00 2024-09-15T12:15:03.160 INFO:teuthology.orchestra.run.smithi092.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-09-15T12:15:03.185 INFO:teuthology.orchestra.run.smithi092.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 713 kB/s | 16 kB 00:00 2024-09-15T12:15:03.210 INFO:teuthology.orchestra.run.smithi092.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-15T12:15:03.236 INFO:teuthology.orchestra.run.smithi092.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-15T12:15:03.261 INFO:teuthology.orchestra.run.smithi092.stdout:(33/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-15T12:15:03.286 INFO:teuthology.orchestra.run.smithi092.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-15T12:15:03.311 INFO:teuthology.orchestra.run.smithi092.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 797 kB/s | 20 kB 00:00 2024-09-15T12:15:03.337 INFO:teuthology.orchestra.run.smithi092.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-15T12:15:12.202 INFO:teuthology.orchestra.run.smithi092.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 6.8 MB/s | 70 MB 00:10 2024-09-15T12:15:12.206 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:12.206 INFO:teuthology.orchestra.run.smithi092.stdout:Total 7.1 MB/s | 84 MB 00:11 2024-09-15T12:15:12.372 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:15:12.419 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:15:12.419 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:15:13.218 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:15:13.218 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:15:14.870 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:15:14.921 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-15T12:15:14.954 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-15T12:15:14.990 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-15T12:15:15.059 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-15T12:15:15.097 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-15T12:15:15.130 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-15T12:15:15.224 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-15T12:15:15.299 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-15T12:15:15.340 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-15T12:15:15.375 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-15T12:15:15.406 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-15T12:15:15.440 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-15T12:15:15.473 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-15T12:15:15.514 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-15T12:15:15.548 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-15T12:15:15.599 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-15T12:15:15.648 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-15T12:15:15.680 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-15T12:15:15.753 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-15T12:15:15.917 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-15T12:15:15.995 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-15T12:15:16.048 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-15T12:15:16.088 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-15T12:15:16.144 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-15T12:15:16.200 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-15T12:15:16.393 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-15T12:15:16.441 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-15T12:15:16.521 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-15T12:15:16.607 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-15T12:15:16.648 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-15T12:15:16.783 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-15T12:15:16.977 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-15T12:15:17.000 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-15T12:15:17.026 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-15T12:15:17.026 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:15:17.026 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T12:15:17.026 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T12:15:17.027 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T12:15:17.027 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:27.600 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-15T12:15:27.629 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-15T12:15:27.630 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:15:27.630 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T12:15:27.630 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T12:15:27.630 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T12:15:27.630 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:28.201 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-15T12:15:28.225 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-15T12:15:28.225 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:15:28.225 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T12:15:28.225 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T12:15:28.225 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T12:15:28.225 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:28.462 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-15T12:15:28.484 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-15T12:15:28.484 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:15:28.484 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T12:15:28.484 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T12:15:28.484 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T12:15:28.484 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:28.562 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-15T12:15:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-15T12:15:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-15T12:15:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-15T12:15:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-15T12:15:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-15T12:15:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-15T12:15:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-15T12:15:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-15T12:15:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-15T12:15:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-15T12:15:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-15T12:15:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-15T12:15:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-15T12:15:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-15T12:15:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-15T12:15:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-15T12:15:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-15T12:15:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-15T12:15:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-15T12:15:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-15T12:15:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-15T12:15:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-15T12:15:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-15T12:15:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-15T12:15:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-15T12:15:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-15T12:15:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-15T12:15:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-15T12:15:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-15T12:15:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-15T12:15:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-15T12:15:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-15T12:15:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-15T12:15:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-15T12:15:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-15T12:15:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-15T12:15:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-15T12:15:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-15T12:15:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:36.147 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:15:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:15:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T12:15:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T12:15:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T12:15:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T12:15:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T12:15:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T12:15:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T12:15:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T12:15:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T12:15:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T12:15:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T12:15:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T12:15:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T12:15:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T12:15:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T12:15:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T12:15:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T12:15:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T12:15:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T12:15:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T12:15:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T12:15:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T12:15:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T12:15:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T12:15:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T12:15:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T12:15:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T12:15:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T12:15:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T12:15:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T12:15:36.151 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T12:15:36.151 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:36.151 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:15:36.449 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-base 2024-09-15T12:15:37.023 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:34 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:15:37.114 INFO:teuthology.orchestra.run.smithi092.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:15:37.155 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:15:37.156 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-15T12:15:37.157 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:15:37.234 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install cephadm 2024-09-15T12:15:37.787 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:34 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:15:37.918 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:15:37.919 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:15:37.919 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-15T12:15:37.919 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:15:37.919 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:15:37.919 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-15T12:15:37.919 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:37.919 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:15:37.920 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:15:37.920 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-15T12:15:37.920 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:37.920 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 785 k 2024-09-15T12:15:37.920 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 791 k 2024-09-15T12:15:37.920 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:15:38.952 INFO:teuthology.orchestra.run.smithi092.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 761 kB/s | 785 kB 00:01 2024-09-15T12:15:38.952 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:38.953 INFO:teuthology.orchestra.run.smithi092.stdout:Total 759 kB/s | 785 kB 00:01 2024-09-15T12:15:38.953 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:15:38.959 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:15:38.959 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:15:38.966 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:15:38.966 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:15:39.040 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:15:39.465 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:15:39.563 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:15:39.941 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:15:40.205 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:15:40.205 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:40.205 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:15:40.205 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:15:40.205 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:40.205 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:15:40.443 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-immutable-object-cache 2024-09-15T12:15:41.022 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:38 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:15:41.158 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:15:41.158 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:15:41.159 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2024-09-15T12:15:41.159 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:15:41.159 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:15:41.159 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-15T12:15:41.159 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:41.159 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:15:41.159 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:15:41.159 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-15T12:15:41.159 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:41.159 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 158 k 2024-09-15T12:15:41.159 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 644 k 2024-09-15T12:15:41.159 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:15:41.665 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 312 kB/s | 158 kB 00:00 2024-09-15T12:15:41.666 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:41.666 INFO:teuthology.orchestra.run.smithi092.stdout:Total 311 kB/s | 158 kB 00:00 2024-09-15T12:15:41.666 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:15:41.676 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:15:41.676 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:15:41.735 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:15:41.735 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:15:41.893 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:15:41.983 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:15:42.008 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:15:42.009 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:15:42.009 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T12:15:42.009 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:42.916 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:15:42.916 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:42.916 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:15:42.917 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:42.917 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:42.917 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:15:43.125 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr 2024-09-15T12:15:43.689 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:40 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:15:43.782 INFO:teuthology.orchestra.run.smithi092.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:15:43.826 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:15:43.826 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-15T12:15:43.827 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:15:43.909 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-dashboard 2024-09-15T12:15:44.476 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:41 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:15:44.610 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:15:44.611 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:15:44.611 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-15T12:15:44.611 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:15:44.611 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:15:44.611 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-15T12:15:44.611 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-15T12:15:44.611 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T12:15:44.611 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-15T12:15:44.611 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-15T12:15:44.611 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T12:15:44.612 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T12:15:44.612 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T12:15:44.612 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T12:15:44.612 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T12:15:44.612 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T12:15:44.612 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T12:15:44.612 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:44.612 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:15:44.612 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:15:44.612 INFO:teuthology.orchestra.run.smithi092.stdout:Install 11 Packages 2024-09-15T12:15:44.612 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:44.613 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 18 M 2024-09-15T12:15:44.613 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 155 M 2024-09-15T12:15:44.613 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:15:45.302 INFO:teuthology.orchestra.run.smithi092.stdout:(1/11): ceph-prometheus-alerts-19.3.0-4879.g81f 53 kB/s | 16 kB 00:00 2024-09-15T12:15:45.318 INFO:teuthology.orchestra.run.smithi092.stdout:(2/11): ceph-grafana-dashboards-19.3.0-4879.g81 105 kB/s | 34 kB 00:00 2024-09-15T12:15:45.436 INFO:teuthology.orchestra.run.smithi092.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 2.0 MB/s | 269 kB 00:00 2024-09-15T12:15:45.486 INFO:teuthology.orchestra.run.smithi092.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-15T12:15:45.503 INFO:teuthology.orchestra.run.smithi092.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-15T12:15:45.536 INFO:teuthology.orchestra.run.smithi092.stdout:(6/11): protobuf-compiler-3.14.0-13.el9.x86_64. 3.9 MB/s | 863 kB 00:00 2024-09-15T12:15:45.595 INFO:teuthology.orchestra.run.smithi092.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.4 MB/s | 144 kB 00:00 2024-09-15T12:15:45.612 INFO:teuthology.orchestra.run.smithi092.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-09-15T12:15:45.655 INFO:teuthology.orchestra.run.smithi092.stdout:(9/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 14 MB/s | 2.0 MB 00:00 2024-09-15T12:15:45.679 INFO:teuthology.orchestra.run.smithi092.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2024-09-15T12:15:47.954 INFO:teuthology.orchestra.run.smithi092.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 4.8 MB/s | 14 MB 00:02 2024-09-15T12:15:47.958 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:47.958 INFO:teuthology.orchestra.run.smithi092.stdout:Total 5.5 MB/s | 18 MB 00:03 2024-09-15T12:15:47.991 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:15:48.011 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:15:48.011 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:15:48.267 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:15:48.267 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:15:48.824 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:15:48.901 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-15T12:15:48.931 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-15T12:15:49.020 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-15T12:15:49.149 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-15T12:15:49.201 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-15T12:15:49.285 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-15T12:15:49.336 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-15T12:15:49.365 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-15T12:15:49.397 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-15T12:15:52.569 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-15T12:15:52.626 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-15T12:15:54.487 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-15T12:15:54.487 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-15T12:15:54.487 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-15T12:15:54.487 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-15T12:15:54.487 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-15T12:15:54.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-15T12:15:54.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-15T12:15:54.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-15T12:15:54.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-15T12:15:54.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-15T12:15:54.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-15T12:15:54.797 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-15T12:15:54.797 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:54.797 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:15:54.797 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T12:15:54.797 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:15:54.797 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:15:54.797 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:15:54.797 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T12:15:54.797 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T12:15:54.797 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T12:15:54.797 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T12:15:54.798 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T12:15:54.798 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T12:15:54.798 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T12:15:54.798 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:54.798 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:15:55.083 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-15T12:15:55.648 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:52 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:15:55.782 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:15:55.783 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================= 2024-09-15T12:15:55.783 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-15T12:15:55.783 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================= 2024-09-15T12:15:55.783 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:15:55.783 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-15T12:15:55.783 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-15T12:15:55.783 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T12:15:55.783 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T12:15:55.783 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T12:15:55.783 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T12:15:55.783 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T12:15:55.784 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T12:15:55.784 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T12:15:55.784 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T12:15:55.784 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T12:15:55.784 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T12:15:55.784 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T12:15:55.784 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:55.784 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:15:55.784 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================= 2024-09-15T12:15:55.784 INFO:teuthology.orchestra.run.smithi092.stdout:Install 12 Packages 2024-09-15T12:15:55.784 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:15:55.785 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 38 M 2024-09-15T12:15:55.785 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 212 M 2024-09-15T12:15:55.785 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:15:56.491 INFO:teuthology.orchestra.run.smithi092.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 338 kB/s | 191 kB 00:00 2024-09-15T12:15:56.592 INFO:teuthology.orchestra.run.smithi092.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 327 kB/s | 33 kB 00:00 2024-09-15T12:15:56.642 INFO:teuthology.orchestra.run.smithi092.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-15T12:15:56.767 INFO:teuthology.orchestra.run.smithi092.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 146 kB/s | 18 kB 00:00 2024-09-15T12:15:56.834 INFO:teuthology.orchestra.run.smithi092.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 577 kB/s | 38 kB 00:00 2024-09-15T12:15:56.884 INFO:teuthology.orchestra.run.smithi092.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 10 MB/s | 3.0 MB 00:00 2024-09-15T12:15:56.935 INFO:teuthology.orchestra.run.smithi092.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-15T12:15:57.077 INFO:teuthology.orchestra.run.smithi092.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-09-15T12:15:57.152 INFO:teuthology.orchestra.run.smithi092.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 16 MB/s | 4.9 MB 00:00 2024-09-15T12:15:57.177 INFO:teuthology.orchestra.run.smithi092.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.4 MB/s | 250 kB 00:00 2024-09-15T12:15:57.436 INFO:teuthology.orchestra.run.smithi092.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 57 MB/s | 16 MB 00:00 2024-09-15T12:15:58.536 INFO:teuthology.orchestra.run.smithi092.stdout:(12/12): ceph-mgr-diskprediction-local-19.3.0-4 2.8 MB/s | 7.4 MB 00:02 2024-09-15T12:15:58.537 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:58.537 INFO:teuthology.orchestra.run.smithi092.stdout:Total 14 MB/s | 38 MB 00:02 2024-09-15T12:15:58.895 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:15:58.920 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:15:58.920 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:15:59.349 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:15:59.350 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:16:00.130 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:16:00.202 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-15T12:16:00.242 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-15T12:16:00.341 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-15T12:16:00.385 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-15T12:16:00.568 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-15T12:16:00.600 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-15T12:16:00.676 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-15T12:16:01.346 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-15T12:16:01.463 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-15T12:16:02.694 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-15T12:16:03.722 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-15T12:16:03.757 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-15T12:16:06.288 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-15T12:16:06.288 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-15T12:16:06.288 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-15T12:16:06.288 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-15T12:16:06.289 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-15T12:16:06.289 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-15T12:16:06.289 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-15T12:16:06.289 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-15T12:16:06.289 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-15T12:16:06.289 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-15T12:16:06.289 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-15T12:16:06.289 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-15T12:16:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-15T12:16:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:06.749 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:16:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:16:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T12:16:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T12:16:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T12:16:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T12:16:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T12:16:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T12:16:06.750 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T12:16:06.750 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T12:16:06.750 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T12:16:06.750 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T12:16:06.750 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T12:16:06.750 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:06.750 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:07.158 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-rook 2024-09-15T12:16:07.736 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:04 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:07.869 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:07.870 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:07.870 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-15T12:16:07.870 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:07.870 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:16:07.870 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-15T12:16:07.870 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-15T12:16:07.870 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T12:16:07.870 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T12:16:07.870 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T12:16:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T12:16:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T12:16:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T12:16:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T12:16:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T12:16:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T12:16:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T12:16:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T12:16:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T12:16:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:07.871 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:16:07.871 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:07.871 INFO:teuthology.orchestra.run.smithi092.stdout:Install 13 Packages 2024-09-15T12:16:07.871 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:07.872 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 2.2 M 2024-09-15T12:16:07.872 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 26 M 2024-09-15T12:16:07.872 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:16:08.215 INFO:teuthology.orchestra.run.smithi092.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 143 kB/s | 26 kB 00:00 2024-09-15T12:16:08.232 INFO:teuthology.orchestra.run.smithi092.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 98 kB/s | 19 kB 00:00 2024-09-15T12:16:08.407 INFO:teuthology.orchestra.run.smithi092.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 908 kB/s | 159 kB 00:00 2024-09-15T12:16:08.449 INFO:teuthology.orchestra.run.smithi092.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.0 MB/s | 222 kB 00:00 2024-09-15T12:16:08.507 INFO:teuthology.orchestra.run.smithi092.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-09-15T12:16:08.533 INFO:teuthology.orchestra.run.smithi092.stdout:(6/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 99 kB/s | 49 kB 00:00 2024-09-15T12:16:08.558 INFO:teuthology.orchestra.run.smithi092.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 493 kB/s | 54 kB 00:00 2024-09-15T12:16:08.608 INFO:teuthology.orchestra.run.smithi092.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-15T12:16:08.634 INFO:teuthology.orchestra.run.smithi092.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-15T12:16:08.659 INFO:teuthology.orchestra.run.smithi092.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-15T12:16:08.684 INFO:teuthology.orchestra.run.smithi092.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-15T12:16:08.709 INFO:teuthology.orchestra.run.smithi092.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-15T12:16:08.751 INFO:teuthology.orchestra.run.smithi092.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.3 MB/s | 1.0 MB 00:00 2024-09-15T12:16:08.754 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:08.754 INFO:teuthology.orchestra.run.smithi092.stdout:Total 2.5 MB/s | 2.2 MB 00:00 2024-09-15T12:16:08.818 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:16:08.834 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:16:08.834 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:16:08.921 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:16:08.922 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:16:09.421 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:16:09.599 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-15T12:16:09.652 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-15T12:16:09.708 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-15T12:16:09.744 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-15T12:16:09.786 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-15T12:16:09.888 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-15T12:16:09.999 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-15T12:16:10.054 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-15T12:16:10.772 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-15T12:16:10.818 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-15T12:16:10.881 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-15T12:16:10.933 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-15T12:16:10.955 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-15T12:16:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-15T12:16:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-15T12:16:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-15T12:16:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-15T12:16:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-15T12:16:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-15T12:16:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-15T12:16:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-15T12:16:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-15T12:16:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-15T12:16:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-15T12:16:11.722 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-15T12:16:11.722 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-15T12:16:12.066 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-15T12:16:12.066 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:12.067 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:16:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:16:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T12:16:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T12:16:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T12:16:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T12:16:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T12:16:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T12:16:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T12:16:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T12:16:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T12:16:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T12:16:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T12:16:12.068 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T12:16:12.068 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:12.068 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:12.358 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-cephadm 2024-09-15T12:16:12.924 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:09 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:13.057 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:13.057 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:13.058 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-15T12:16:13.058 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:13.058 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:16:13.058 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-15T12:16:13.058 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-15T12:16:13.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T12:16:13.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T12:16:13.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T12:16:13.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T12:16:13.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T12:16:13.058 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:13.058 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:16:13.058 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:13.059 INFO:teuthology.orchestra.run.smithi092.stdout:Install 6 Packages 2024-09-15T12:16:13.059 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:13.059 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 7.0 M 2024-09-15T12:16:13.059 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 33 M 2024-09-15T12:16:13.059 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:16:13.610 INFO:teuthology.orchestra.run.smithi092.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-15T12:16:13.660 INFO:teuthology.orchestra.run.smithi092.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-15T12:16:13.685 INFO:teuthology.orchestra.run.smithi092.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-15T12:16:13.711 INFO:teuthology.orchestra.run.smithi092.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-15T12:16:14.019 INFO:teuthology.orchestra.run.smithi092.stdout:(5/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 248 kB/s | 154 kB 00:00 2024-09-15T12:16:14.828 INFO:teuthology.orchestra.run.smithi092.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.2 MB/s | 6.0 MB 00:01 2024-09-15T12:16:14.829 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:14.830 INFO:teuthology.orchestra.run.smithi092.stdout:Total 4.0 MB/s | 7.0 MB 00:01 2024-09-15T12:16:14.900 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:16:14.912 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:16:14.912 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:16:15.012 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:16:15.013 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:16:15.316 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:16:15.484 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-15T12:16:15.529 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-15T12:16:16.057 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-15T12:16:16.140 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-15T12:16:16.207 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-15T12:16:16.233 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-15T12:16:17.044 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-15T12:16:17.044 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-15T12:16:17.044 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-15T12:16:17.044 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-15T12:16:17.044 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-15T12:16:17.044 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-15T12:16:17.331 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-15T12:16:17.331 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:17.331 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:16:17.331 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:16:17.331 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T12:16:17.331 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T12:16:17.331 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T12:16:17.332 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T12:16:17.332 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T12:16:17.332 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:17.332 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:17.608 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-fuse 2024-09-15T12:16:18.176 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:15 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:18.309 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:18.310 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:18.310 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-15T12:16:18.311 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:18.311 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:16:18.311 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-15T12:16:18.311 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-15T12:16:18.311 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T12:16:18.311 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:18.311 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:16:18.311 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:18.311 INFO:teuthology.orchestra.run.smithi092.stdout:Install 2 Packages 2024-09-15T12:16:18.311 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:18.311 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 964 k 2024-09-15T12:16:18.311 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 4.1 M 2024-09-15T12:16:18.311 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:16:18.979 INFO:teuthology.orchestra.run.smithi092.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 123 kB/s | 80 kB 00:00 2024-09-15T12:16:19.271 INFO:teuthology.orchestra.run.smithi092.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 942 kB/s | 884 kB 00:00 2024-09-15T12:16:19.271 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:19.272 INFO:teuthology.orchestra.run.smithi092.stdout:Total 1.0 MB/s | 964 kB 00:00 2024-09-15T12:16:19.286 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:16:19.312 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:16:19.312 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:16:19.395 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:16:19.395 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:16:19.586 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:16:19.731 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-15T12:16:19.803 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-15T12:16:20.485 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-15T12:16:20.485 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-15T12:16:20.771 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-15T12:16:20.771 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:20.771 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:16:20.771 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-15T12:16:20.771 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:20.772 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:21.101 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-volume 2024-09-15T12:16:21.672 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:18 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:21.812 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:21.812 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:21.812 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-15T12:16:21.812 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:21.812 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:16:21.813 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-15T12:16:21.813 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:21.813 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:16:21.813 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:21.813 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-15T12:16:21.813 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:21.813 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 285 k 2024-09-15T12:16:21.813 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 1.3 M 2024-09-15T12:16:21.813 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:16:22.617 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 355 kB/s | 285 kB 00:00 2024-09-15T12:16:22.617 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:22.618 INFO:teuthology.orchestra.run.smithi092.stdout:Total 354 kB/s | 285 kB 00:00 2024-09-15T12:16:22.618 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:16:22.627 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:16:22.627 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:16:22.657 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:16:22.657 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:16:22.879 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:16:22.960 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:16:22.977 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:16:22.977 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:16:22.977 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T12:16:22.977 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:24.013 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:16:24.014 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:24.014 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:16:24.014 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:16:24.014 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:24.014 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:24.328 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install librados-devel 2024-09-15T12:16:24.901 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:21 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:25.036 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:25.037 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:25.037 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2024-09-15T12:16:25.037 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:25.037 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:16:25.037 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-15T12:16:25.038 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:25.038 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:16:25.038 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:25.038 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-15T12:16:25.038 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:25.038 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 125 k 2024-09-15T12:16:25.038 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 445 k 2024-09-15T12:16:25.038 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:16:25.988 INFO:teuthology.orchestra.run.smithi092.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 131 kB/s | 125 kB 00:00 2024-09-15T12:16:25.988 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:25.989 INFO:teuthology.orchestra.run.smithi092.stdout:Total 131 kB/s | 125 kB 00:00 2024-09-15T12:16:25.989 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:16:25.994 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:16:25.994 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:16:26.061 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:16:26.062 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:16:26.232 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:16:26.347 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:26.792 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:27.054 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:27.054 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:27.054 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:16:27.055 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:27.055 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:27.055 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:27.323 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install libcephfs2 2024-09-15T12:16:27.896 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:24 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:27.989 INFO:teuthology.orchestra.run.smithi092.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:16:28.034 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:28.035 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-15T12:16:28.035 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:28.115 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install libcephfs-devel 2024-09-15T12:16:28.682 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:25 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:28.815 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:28.816 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:28.816 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2024-09-15T12:16:28.816 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:28.816 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:16:28.816 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-15T12:16:28.816 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:28.816 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:16:28.816 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:28.816 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-15T12:16:28.816 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:28.816 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 32 k 2024-09-15T12:16:28.816 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 142 k 2024-09-15T12:16:28.816 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:16:29.341 INFO:teuthology.orchestra.run.smithi092.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 60 kB/s | 32 kB 00:00 2024-09-15T12:16:29.341 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:29.342 INFO:teuthology.orchestra.run.smithi092.stdout:Total 60 kB/s | 32 kB 00:00 2024-09-15T12:16:29.342 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:16:29.345 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:16:29.346 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:16:29.363 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:16:29.363 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:16:29.456 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:16:29.580 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:29.933 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:30.160 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:30.160 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:30.160 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:16:30.160 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:30.160 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:30.160 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:30.363 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install librados2 2024-09-15T12:16:30.924 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:27 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:31.014 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:16:31.057 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:31.058 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-15T12:16:31.058 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:31.140 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install librbd1 2024-09-15T12:16:31.699 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:28 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:31.788 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:16:31.831 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:31.831 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-15T12:16:31.832 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:31.920 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-rados 2024-09-15T12:16:32.484 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:29 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:32.575 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:16:32.619 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:32.620 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-15T12:16:32.620 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:32.698 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-rgw 2024-09-15T12:16:33.258 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:30 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:33.350 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:16:33.393 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:33.394 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-15T12:16:33.394 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:33.473 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-cephfs 2024-09-15T12:16:34.040 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:31 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:34.132 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:16:34.175 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:34.176 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-15T12:16:34.176 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:34.256 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-rbd 2024-09-15T12:16:34.819 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:31 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:34.909 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:16:34.952 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:34.953 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-15T12:16:34.953 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:35.028 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install rbd-fuse 2024-09-15T12:16:35.599 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:32 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:35.732 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:35.733 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-15T12:16:35.733 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:35.733 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:16:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-15T12:16:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:35.733 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:16:35.734 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:35.734 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-15T12:16:35.734 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:35.734 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 91 k 2024-09-15T12:16:35.734 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 321 k 2024-09-15T12:16:35.734 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:16:36.327 INFO:teuthology.orchestra.run.smithi092.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 153 kB/s | 91 kB 00:00 2024-09-15T12:16:36.327 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:36.328 INFO:teuthology.orchestra.run.smithi092.stdout:Total 153 kB/s | 91 kB 00:00 2024-09-15T12:16:36.328 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:16:36.337 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:16:36.337 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:16:36.403 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:16:36.403 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:16:36.552 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:16:36.665 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:37.058 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:37.326 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:37.326 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:37.326 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:16:37.326 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:37.326 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:37.326 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:37.593 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install rbd-mirror 2024-09-15T12:16:38.172 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:35 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:38.312 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:38.313 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:38.313 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2024-09-15T12:16:38.313 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:38.313 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:16:38.313 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-15T12:16:38.313 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:38.313 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:16:38.313 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:38.313 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-15T12:16:38.313 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:38.313 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 3.5 M 2024-09-15T12:16:38.314 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 30 M 2024-09-15T12:16:38.314 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:16:42.362 INFO:teuthology.orchestra.run.smithi092.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 887 kB/s | 3.5 MB 00:04 2024-09-15T12:16:42.363 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:42.363 INFO:teuthology.orchestra.run.smithi092.stdout:Total 886 kB/s | 3.5 MB 00:04 2024-09-15T12:16:42.363 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:16:42.376 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:16:42.376 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:16:42.463 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:16:42.464 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:16:43.053 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:16:43.143 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:43.168 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:43.168 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:16:43.168 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T12:16:43.169 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T12:16:43.169 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T12:16:43.169 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:44.390 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:44.391 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:44.391 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:16:44.391 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:44.391 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:44.391 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:44.649 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install rbd-nbd 2024-09-15T12:16:45.232 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:42 ago on Sun 15 Sep 2024 12:14:03 PM UTC. 2024-09-15T12:16:45.367 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-15T12:16:45.367 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:45.367 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-15T12:16:45.367 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:45.367 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-15T12:16:45.368 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-15T12:16:45.368 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:45.368 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-15T12:16:45.368 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-15T12:16:45.368 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-15T12:16:45.368 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:45.368 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 177 k 2024-09-15T12:16:45.368 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 685 k 2024-09-15T12:16:45.369 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-15T12:16:46.190 INFO:teuthology.orchestra.run.smithi092.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 215 kB/s | 177 kB 00:00 2024-09-15T12:16:46.190 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:46.191 INFO:teuthology.orchestra.run.smithi092.stdout:Total 215 kB/s | 177 kB 00:00 2024-09-15T12:16:46.191 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-15T12:16:46.201 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-15T12:16:46.201 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-15T12:16:46.275 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-15T12:16:46.275 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-15T12:16:46.448 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-15T12:16:46.546 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:46.966 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:47.175 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-15T12:16:47.175 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:47.175 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:47.175 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-15T12:16:47.452 DEBUG:teuthology.parallel:result is None 2024-09-15T12:16:47.453 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:16:47.596 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T12:16:47.618 INFO:teuthology.orchestra.run.smithi092.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-15T12:16:47.618 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-15T12:16:47.618 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-15T12:16:47.620 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T12:16:47.620 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:16:47.620 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T12:16:47.683 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T12:16:47.683 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:16:47.683 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T12:16:47.747 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T12:16:47.812 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T12:16:47.812 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:16:47.813 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T12:16:47.877 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T12:16:47.941 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T12:16:47.942 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:16:47.942 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T12:16:48.006 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T12:16:48.071 INFO:teuthology.run_tasks:Running task ceph... 2024-09-15T12:16:48.150 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-15T12:16:48.150 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /var/log/ceph 2024-09-15T12:16:48.175 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-15T12:16:48.175 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T12:16:48.256 INFO:tasks.ceph:Creating extra log directories... 2024-09-15T12:16:48.257 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T12:16:48.328 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-15T12:16:48.329 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-15T12:16:48.329 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905527', 'branch': 'wip-matanb-crimson-testing-59543', 'description': 'crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests_old_format}', 'email': None, 'first_in_suite': False, 'job_id': '7905527', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 1236, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi092.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNoRO9Se7iHsmdTmrOJZbIxgIgmJxMNs3bZxT2bTQIONOAm3jNGd5NnwDZHtvPPVwkzrVyXNbueC+6M6kvXOLus='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rbd/crimson/test_crimson_librbd.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_11:59:21', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-15T12:16:48.329 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T12:16:48.377 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T12:16:48.443 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:16:48.443 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T12:16:48.499 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T12:16:48.499 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2024-09-15T12:16:48.555 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T12:16:48.555 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:16:48.555 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-15T12:16:48.555 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:16:48.555 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:16:48.555 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-15 12:16:43.422173738 +0000 2024-09-15T12:16:48.555 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-15 12:13:17.853543826 +0000 2024-09-15T12:16:48.556 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-15 12:13:17.853543826 +0000 2024-09-15T12:16:48.556 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-15 12:13:17.853543826 +0000 2024-09-15T12:16:48.556 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T12:16:48.618 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-15T12:16:48.618 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-15T12:16:48.618 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000204764 s, 2.5 MB/s 2024-09-15T12:16:48.619 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T12:16:48.676 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2024-09-15T12:16:48.731 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T12:16:48.731 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:16:48.731 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-15T12:16:48.731 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:16:48.731 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:16:48.731 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-15 12:16:43.422173738 +0000 2024-09-15T12:16:48.731 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-15 12:13:18.240532305 +0000 2024-09-15T12:16:48.732 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-15 12:13:18.240532305 +0000 2024-09-15T12:16:48.732 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-15 12:13:18.240532305 +0000 2024-09-15T12:16:48.732 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T12:16:48.795 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-15T12:16:48.795 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-15T12:16:48.795 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000257411 s, 2.0 MB/s 2024-09-15T12:16:48.796 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T12:16:48.853 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2024-09-15T12:16:48.907 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T12:16:48.907 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:16:48.907 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-15T12:16:48.908 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:16:48.908 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:16:48.908 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-15 12:16:43.423173710 +0000 2024-09-15T12:16:48.908 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-15 12:13:18.595521739 +0000 2024-09-15T12:16:48.908 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-15 12:13:18.595521739 +0000 2024-09-15T12:16:48.908 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-15 12:13:18.595521739 +0000 2024-09-15T12:16:48.908 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T12:16:48.971 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-15T12:16:48.971 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-15T12:16:48.971 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000234124 s, 2.2 MB/s 2024-09-15T12:16:48.972 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T12:16:49.028 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2024-09-15T12:16:49.083 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T12:16:49.084 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:16:49.084 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-15T12:16:49.084 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:16:49.084 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:16:49.084 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-15 12:16:43.423173710 +0000 2024-09-15T12:16:49.084 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-15 12:13:18.995509829 +0000 2024-09-15T12:16:49.084 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-15 12:13:18.995509829 +0000 2024-09-15T12:16:49.084 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-15 12:13:18.995509829 +0000 2024-09-15T12:16:49.084 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T12:16:49.146 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-15T12:16:49.146 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-15T12:16:49.146 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.00018667 s, 2.7 MB/s 2024-09-15T12:16:49.148 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T12:16:49.203 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-15T12:16:49.203 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-15T12:16:49.204 INFO:tasks.ceph:Generating config... 2024-09-15T12:16:49.205 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-15T12:16:49.205 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-15T12:16:49.205 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-15T12:16:49.205 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-15T12:16:49.205 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-15T12:16:49.205 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-15T12:16:49.205 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-15T12:16:49.205 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-15T12:16:49.205 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-15T12:16:49.205 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-15T12:16:49.205 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-15T12:16:49.205 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] log to file = False 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-15T12:16:49.206 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-15T12:16:49.207 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-15T12:16:49.207 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-15T12:16:49.207 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-15T12:16:49.207 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-15T12:16:49.207 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-15T12:16:49.207 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-15T12:16:49.207 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-15T12:16:49.207 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-15T12:16:49.207 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-15T12:16:49.207 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-15T12:16:49.207 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-15T12:16:49.207 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-15T12:16:49.207 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-15T12:16:49.207 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-15T12:16:49.208 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-1 2024-09-15T12:16:49.208 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 2-3 2024-09-15T12:16:49.208 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 4-5 2024-09-15T12:16:49.208 INFO:tasks.ceph:Setting up mon.a... 2024-09-15T12:16:49.208 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-15T12:16:49.300 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.keyring 2024-09-15T12:16:49.303 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-15T12:16:49.354 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T12:16:49.378 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.92')] 2024-09-15T12:16:49.378 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.92', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}} 2024-09-15T12:16:49.379 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:16:49.379 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T12:16:49.434 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.92 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:16:49.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:16:49.524+0000 7f640a509f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:49.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:16:49.524+0000 7f640a509f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:49.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:16:49.525+0000 7f640a509f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:49.526 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:16:49.526 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: generated fsid b40a72a8-68fe-4cd3-b94d-fb82d50c7882 2024-09-15T12:16:49.526 INFO:teuthology.orchestra.run.smithi092.stdout:setting min_mon_release = quincy 2024-09-15T12:16:49.526 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 0 2024-09-15T12:16:49.527 INFO:teuthology.orchestra.run.smithi092.stdout:fsid b40a72a8-68fe-4cd3-b94d-fb82d50c7882 2024-09-15T12:16:49.527 INFO:teuthology.orchestra.run.smithi092.stdout:last_changed 2024-09-15T12:16:49.525457+0000 2024-09-15T12:16:49.527 INFO:teuthology.orchestra.run.smithi092.stdout:created 2024-09-15T12:16:49.525457+0000 2024-09-15T12:16:49.527 INFO:teuthology.orchestra.run.smithi092.stdout:min_mon_release 17 (quincy) 2024-09-15T12:16:49.527 INFO:teuthology.orchestra.run.smithi092.stdout:election_strategy: 1 2024-09-15T12:16:49.527 INFO:teuthology.orchestra.run.smithi092.stdout:0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-15T12:16:49.527 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-15T12:16:49.528 DEBUG:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T12:16:49.543 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b40a72a8-68fe-4cd3-b94d-fb82d50c7882... 2024-09-15T12:16:49.544 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T12:16:49.625 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2024-09-15T12:16:49.625 INFO:teuthology.orchestra.run.smithi092.stdout: chdir = "" 2024-09-15T12:16:49.625 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T12:16:49.625 INFO:teuthology.orchestra.run.smithi092.stdout: auth supported = cephx 2024-09-15T12:16:49.625 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.625 INFO:teuthology.orchestra.run.smithi092.stdout: filestore xattr use omap = true 2024-09-15T12:16:49.625 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.625 INFO:teuthology.orchestra.run.smithi092.stdout: mon clock drift allowed = 1.000 2024-09-15T12:16:49.625 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.625 INFO:teuthology.orchestra.run.smithi092.stdout: osd crush chooseleaf type = 0 2024-09-15T12:16:49.625 INFO:teuthology.orchestra.run.smithi092.stdout: auth debug = true 2024-09-15T12:16:49.625 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.625 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on old message = true 2024-09-15T12:16:49.625 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on bug = true 2024-09-15T12:16:49.626 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.626 INFO:teuthology.orchestra.run.smithi092.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T12:16:49.626 INFO:teuthology.orchestra.run.smithi092.stdout: mon pg warn max object skew = 0 2024-09-15T12:16:49.626 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.626 INFO:teuthology.orchestra.run.smithi092.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T12:16:49.626 INFO:teuthology.orchestra.run.smithi092.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T12:16:49.626 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.626 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default size = 2 2024-09-15T12:16:49.626 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.626 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow primary affinity = true 2024-09-15T12:16:49.627 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow pg remap = true 2024-09-15T12:16:49.627 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on legacy crush tunables = false 2024-09-15T12:16:49.627 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on crush straw calc version zero = false 2024-09-15T12:16:49.627 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on no sortbitwise = false 2024-09-15T12:16:49.627 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on osd down out interval zero = false 2024-09-15T12:16:49.627 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on too few osds = false 2024-09-15T12:16:49.627 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T12:16:49.627 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T12:16:49.627 INFO:teuthology.orchestra.run.smithi092.stdout: mon_allow_pool_size_one = true 2024-09-15T12:16:49.627 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.627 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T12:16:49.627 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.627 INFO:teuthology.orchestra.run.smithi092.stdout: osd default data pool replay window = 5 2024-09-15T12:16:49.627 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.628 INFO:teuthology.orchestra.run.smithi092.stdout: mon allow pool delete = true 2024-09-15T12:16:49.628 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.628 INFO:teuthology.orchestra.run.smithi092.stdout: mon cluster log file level = debug 2024-09-15T12:16:49.628 INFO:teuthology.orchestra.run.smithi092.stdout: debug asserts on shutdown = true 2024-09-15T12:16:49.628 INFO:teuthology.orchestra.run.smithi092.stdout: mon health detail to clog = false 2024-09-15T12:16:49.628 INFO:teuthology.orchestra.run.smithi092.stdout: mon host = 172.21.15.92 2024-09-15T12:16:49.628 INFO:teuthology.orchestra.run.smithi092.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-15T12:16:49.628 INFO:teuthology.orchestra.run.smithi092.stdout: ms client mode = crc 2024-09-15T12:16:49.628 INFO:teuthology.orchestra.run.smithi092.stdout: ms cluster mode = crc 2024-09-15T12:16:49.628 INFO:teuthology.orchestra.run.smithi092.stdout: ms mon client mode = crc 2024-09-15T12:16:49.628 INFO:teuthology.orchestra.run.smithi092.stdout: ms mon cluster mode = crc 2024-09-15T12:16:49.628 INFO:teuthology.orchestra.run.smithi092.stdout: ms mon service mode = crc 2024-09-15T12:16:49.628 INFO:teuthology.orchestra.run.smithi092.stdout: ms service mode = crc 2024-09-15T12:16:49.628 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = b40a72a8-68fe-4cd3-b94d-fb82d50c7882 2024-09-15T12:16:49.629 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.629 INFO:teuthology.orchestra.run.smithi092.stdout:[osd] 2024-09-15T12:16:49.629 INFO:teuthology.orchestra.run.smithi092.stdout: osd journal size = 100 2024-09-15T12:16:49.629 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.629 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub load threshold = 5.0 2024-09-15T12:16:49.629 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub max interval = 600 2024-09-15T12:16:49.629 INFO:teuthology.orchestra.run.smithi092.stdout: osd mclock profile = high_recovery_ops 2024-09-15T12:16:49.629 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.629 INFO:teuthology.orchestra.run.smithi092.stdout: osd recover clone overlap = true 2024-09-15T12:16:49.629 INFO:teuthology.orchestra.run.smithi092.stdout: osd recovery max chunk = 1048576 2024-09-15T12:16:49.629 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.629 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug shutdown = true 2024-09-15T12:16:49.629 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug op order = true 2024-09-15T12:16:49.630 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug verify stray on activate = true 2024-09-15T12:16:49.630 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug trim objects = true 2024-09-15T12:16:49.630 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.630 INFO:teuthology.orchestra.run.smithi092.stdout: osd open classes on start = true 2024-09-15T12:16:49.630 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug pg log writeout = true 2024-09-15T12:16:49.630 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.630 INFO:teuthology.orchestra.run.smithi092.stdout: osd deep scrub update digest min age = 30 2024-09-15T12:16:49.630 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.630 INFO:teuthology.orchestra.run.smithi092.stdout: osd map max advance = 10 2024-09-15T12:16:49.630 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.630 INFO:teuthology.orchestra.run.smithi092.stdout: journal zero on create = true 2024-09-15T12:16:49.630 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.630 INFO:teuthology.orchestra.run.smithi092.stdout: filestore ondisk finisher threads = 3 2024-09-15T12:16:49.630 INFO:teuthology.orchestra.run.smithi092.stdout: filestore apply finisher threads = 3 2024-09-15T12:16:49.631 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.631 INFO:teuthology.orchestra.run.smithi092.stdout: bdev debug aio = true 2024-09-15T12:16:49.631 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug misdirected ops = true 2024-09-15T12:16:49.631 INFO:teuthology.orchestra.run.smithi092.stdout: debug monc = 20 2024-09-15T12:16:49.631 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore block size = 96636764160 2024-09-15T12:16:49.631 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore compression algorithm = snappy 2024-09-15T12:16:49.631 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore compression mode = aggressive 2024-09-15T12:16:49.631 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore fsck on mount = True 2024-09-15T12:16:49.631 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore rocksdb cf = False 2024-09-15T12:16:49.631 INFO:teuthology.orchestra.run.smithi092.stdout: crimson alien thread cpu cores = 6-7 2024-09-15T12:16:49.631 INFO:teuthology.orchestra.run.smithi092.stdout: crimson osd obc lru size = 10 2024-09-15T12:16:49.631 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluefs = 20 2024-09-15T12:16:49.631 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluestore = 20 2024-09-15T12:16:49.631 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-09-15T12:16:49.632 INFO:teuthology.orchestra.run.smithi092.stdout: debug osd = 20 2024-09-15T12:16:49.632 INFO:teuthology.orchestra.run.smithi092.stdout: debug rocksdb = 10 2024-09-15T12:16:49.632 INFO:teuthology.orchestra.run.smithi092.stdout: err to stderr = True 2024-09-15T12:16:49.632 INFO:teuthology.orchestra.run.smithi092.stdout: log flush on exit = True 2024-09-15T12:16:49.632 INFO:teuthology.orchestra.run.smithi092.stdout: log to file = False 2024-09-15T12:16:49.632 INFO:teuthology.orchestra.run.smithi092.stdout: log to stderr = True 2024-09-15T12:16:49.632 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T12:16:49.632 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd full ratio = 0.9 2024-09-15T12:16:49.632 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd nearfull ratio = 0.8 2024-09-15T12:16:49.632 INFO:teuthology.orchestra.run.smithi092.stdout: osd failsafe full ratio = 0.95 2024-09-15T12:16:49.632 INFO:teuthology.orchestra.run.smithi092.stdout: osd objectstore = bluestore 2024-09-15T12:16:49.632 INFO:teuthology.orchestra.run.smithi092.stdout: osd shutdown pgref assert = True 2024-09-15T12:16:49.632 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.632 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr] 2024-09-15T12:16:49.633 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-09-15T12:16:49.633 INFO:teuthology.orchestra.run.smithi092.stdout: debug mgr = 20 2024-09-15T12:16:49.633 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2024-09-15T12:16:49.633 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2024-09-15T12:16:49.633 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2024-09-15T12:16:49.633 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2024-09-15T12:16:49.633 INFO:teuthology.orchestra.run.smithi092.stdout: mgr/telemetry/nag = false 2024-09-15T12:16:49.633 INFO:teuthology.orchestra.run.smithi092.stdout: mgr stats period = 30 2024-09-15T12:16:49.633 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.633 INFO:teuthology.orchestra.run.smithi092.stdout:[mon] 2024-09-15T12:16:49.633 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-09-15T12:16:49.633 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2024-09-15T12:16:49.633 INFO:teuthology.orchestra.run.smithi092.stdout: debug paxos = 20 2024-09-15T12:16:49.633 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2024-09-15T12:16:49.633 INFO:teuthology.orchestra.run.smithi092.stdout: mon data avail warn = 5 2024-09-15T12:16:49.634 INFO:teuthology.orchestra.run.smithi092.stdout: mon mgr mkfs grace = 240 2024-09-15T12:16:49.634 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2024-09-15T12:16:49.634 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd reporter subtree level = osd 2024-09-15T12:16:49.634 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd prime pg temp = true 2024-09-15T12:16:49.634 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2024-09-15T12:16:49.634 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.634 INFO:teuthology.orchestra.run.smithi092.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T12:16:49.634 INFO:teuthology.orchestra.run.smithi092.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T12:16:49.634 INFO:teuthology.orchestra.run.smithi092.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T12:16:49.634 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.634 INFO:teuthology.orchestra.run.smithi092.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T12:16:49.634 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T12:16:49.634 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T12:16:49.634 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.635 INFO:teuthology.orchestra.run.smithi092.stdout: # 1m isn't quite enough 2024-09-15T12:16:49.635 INFO:teuthology.orchestra.run.smithi092.stdout: mon_down_mkfs_grace = 2m 2024-09-15T12:16:49.635 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.635 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_filestore_osds = false 2024-09-15T12:16:49.635 INFO:teuthology.orchestra.run.smithi092.stdout: mon min osdmap epochs = 50 2024-09-15T12:16:49.635 INFO:teuthology.orchestra.run.smithi092.stdout: mon osdmap full prune interval = 2 2024-09-15T12:16:49.635 INFO:teuthology.orchestra.run.smithi092.stdout: mon osdmap full prune min = 15 2024-09-15T12:16:49.635 INFO:teuthology.orchestra.run.smithi092.stdout: mon osdmap full prune txsize = 2 2024-09-15T12:16:49.635 INFO:teuthology.orchestra.run.smithi092.stdout: paxos service trim min = 10 2024-09-15T12:16:49.635 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default crimson = True 2024-09-15T12:16:49.635 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:16:49.635 INFO:teuthology.orchestra.run.smithi092.stdout:[client] 2024-09-15T12:16:49.635 INFO:teuthology.orchestra.run.smithi092.stdout: rgw cache enabled = true 2024-09-15T12:16:49.635 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable ops log = true 2024-09-15T12:16:49.635 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable usage log = true 2024-09-15T12:16:49.636 INFO:teuthology.orchestra.run.smithi092.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T12:16:49.636 INFO:teuthology.orchestra.run.smithi092.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T12:16:49.636 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.a] 2024-09-15T12:16:49.636 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.0] 2024-09-15T12:16:49.636 INFO:teuthology.orchestra.run.smithi092.stdout: crimson seastar cpu cores = 0-1 2024-09-15T12:16:49.636 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.1] 2024-09-15T12:16:49.636 INFO:teuthology.orchestra.run.smithi092.stdout: crimson seastar cpu cores = 2-3 2024-09-15T12:16:49.636 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.2] 2024-09-15T12:16:49.636 INFO:teuthology.orchestra.run.smithi092.stdout: crimson seastar cpu cores = 4-5 2024-09-15T12:16:49.637 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-15T12:16:49.637 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-15T12:16:49.742 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-15T12:16:49.742 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:16:49.742 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-15T12:16:49.757 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:16:49.757 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-15T12:16:49.812 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi092.front.sepia.ceph.com 2024-09-15T12:16:49.812 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:16:49.812 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T12:16:49.812 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T12:16:49.887 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:16:49.887 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:16:49.943 INFO:tasks.ceph:Setting up mon nodes... 2024-09-15T12:16:49.943 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-15T12:16:49.943 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T12:16:50.041 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T12:16:50.045 INFO:tasks.ceph:Setting up mds nodes... 2024-09-15T12:16:50.045 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-15T12:16:50.045 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T12:16:50.094 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-15T12:16:50.107 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-15T12:16:50.107 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-15T12:16:50.107 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-15T12:16:50.131 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-15T12:16:50.131 INFO:tasks.ceph:role: osd.0 2024-09-15T12:16:50.131 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com 2024-09-15T12:16:50.131 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T12:16:50.203 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T12:16:50.203 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T12:16:50.203 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T12:16:50.203 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T12:16:50.203 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T12:16:50.203 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-09-15T12:16:50.203 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T12:16:50.203 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T12:16:50.203 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T12:16:50.203 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T12:16:50.714 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2024-09-15T12:16:50.717 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-09-15T12:16:50.717 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-15T12:16:50.866 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-15T12:16:50.901 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-15T12:16:50.966 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-15T12:16:50.966 INFO:tasks.ceph:role: osd.1 2024-09-15T12:16:50.967 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com 2024-09-15T12:16:50.967 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T12:16:51.039 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T12:16:51.039 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T12:16:51.040 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T12:16:51.040 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T12:16:51.040 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T12:16:51.040 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-09-15T12:16:51.040 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T12:16:51.040 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T12:16:51.040 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T12:16:51.040 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T12:16:51.487 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2024-09-15T12:16:51.489 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-09-15T12:16:51.489 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-15T12:16:51.585 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-15T12:16:51.614 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-15T12:16:51.680 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-15T12:16:51.680 INFO:tasks.ceph:role: osd.2 2024-09-15T12:16:51.680 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com 2024-09-15T12:16:51.680 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T12:16:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T12:16:51.753 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T12:16:51.753 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T12:16:51.753 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T12:16:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T12:16:51.753 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-09-15T12:16:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T12:16:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T12:16:51.754 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T12:16:51.754 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T12:16:52.236 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2024-09-15T12:16:52.239 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-09-15T12:16:52.239 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-15T12:16:52.390 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-15T12:16:52.419 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:16:52.703 INFO:teuthology.orchestra.run.smithi092.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:16:52.705 INFO:teuthology.orchestra.run.smithi092.stderr:INFO 2024-09-15 12:16:52,704 seastar - Reactor backend: linux-aio 2024-09-15T12:16:52.721 INFO:teuthology.orchestra.run.smithi092.stderr:==28310==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:16:52.841 INFO:teuthology.orchestra.run.smithi092.stderr:INFO 2024-09-15 12:16:52,840 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-15T12:16:52.841 INFO:teuthology.orchestra.run.smithi092.stderr:INFO 2024-09-15 12:16:52,840 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-1 2024-09-15T12:16:52.841 INFO:teuthology.orchestra.run.smithi092.stderr:DEBUG 2024-09-15 12:16:52,841 [shard 0:main] seastar - reactor::drain 2024-09-15T12:16:53.385 INFO:teuthology.orchestra.run.smithi092.stderr:----------------------------------------------------- 2024-09-15T12:16:53.385 INFO:teuthology.orchestra.run.smithi092.stderr:Suppressions used: 2024-09-15T12:16:53.385 INFO:teuthology.orchestra.run.smithi092.stderr: count bytes template 2024-09-15T12:16:53.385 INFO:teuthology.orchestra.run.smithi092.stderr: 1 8 MallocExtension::Register 2024-09-15T12:16:53.385 INFO:teuthology.orchestra.run.smithi092.stderr:----------------------------------------------------- 2024-09-15T12:16:53.385 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-09-15T12:16:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:16:53.446 INFO:teuthology.orchestra.run.smithi092.stderr:INFO 2024-09-15 12:16:53,445 seastar - Reactor backend: linux-aio 2024-09-15T12:16:53.454 INFO:teuthology.orchestra.run.smithi092.stderr:==28308==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:16:58.118 INFO:teuthology.orchestra.run.smithi092.stderr:----------------------------------------------------- 2024-09-15T12:16:58.119 INFO:teuthology.orchestra.run.smithi092.stderr:Suppressions used: 2024-09-15T12:16:58.119 INFO:teuthology.orchestra.run.smithi092.stderr: count bytes template 2024-09-15T12:16:58.119 INFO:teuthology.orchestra.run.smithi092.stderr: 1 8 MallocExtension::Register 2024-09-15T12:16:58.119 INFO:teuthology.orchestra.run.smithi092.stderr:----------------------------------------------------- 2024-09-15T12:16:58.119 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-09-15T12:16:58.140 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-15T12:16:58.165 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:16:58.439 INFO:teuthology.orchestra.run.smithi092.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:16:58.440 INFO:teuthology.orchestra.run.smithi092.stderr:INFO 2024-09-15 12:16:58,440 seastar - Reactor backend: linux-aio 2024-09-15T12:16:58.445 INFO:teuthology.orchestra.run.smithi092.stderr:==28494==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:16:58.552 INFO:teuthology.orchestra.run.smithi092.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x156dc 0xdd312 0x4b14c 0x5fea762 0x5ff2471 0x5ff252b 0x60387d1 0x60389d9 0x6038bb9 0x5fb8d06 0x5fb8ee0 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:58.552 INFO:teuthology.orchestra.run.smithi092.stderr:kernel callstack: 2024-09-15T12:16:58.565 INFO:teuthology.orchestra.run.smithi092.stderr:INFO 2024-09-15 12:16:58,564 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-15T12:16:58.565 INFO:teuthology.orchestra.run.smithi092.stderr:INFO 2024-09-15 12:16:58,564 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 2-3 2024-09-15T12:16:58.566 INFO:teuthology.orchestra.run.smithi092.stderr:DEBUG 2024-09-15 12:16:58,565 [shard 0:main] seastar - reactor::drain 2024-09-15T12:16:59.067 INFO:teuthology.orchestra.run.smithi092.stderr:----------------------------------------------------- 2024-09-15T12:16:59.067 INFO:teuthology.orchestra.run.smithi092.stderr:Suppressions used: 2024-09-15T12:16:59.067 INFO:teuthology.orchestra.run.smithi092.stderr: count bytes template 2024-09-15T12:16:59.067 INFO:teuthology.orchestra.run.smithi092.stderr: 1 8 MallocExtension::Register 2024-09-15T12:16:59.067 INFO:teuthology.orchestra.run.smithi092.stderr:----------------------------------------------------- 2024-09-15T12:16:59.067 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-09-15T12:16:59.123 INFO:teuthology.orchestra.run.smithi092.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:16:59.127 INFO:teuthology.orchestra.run.smithi092.stderr:INFO 2024-09-15 12:16:59,126 seastar - Reactor backend: linux-aio 2024-09-15T12:16:59.144 INFO:teuthology.orchestra.run.smithi092.stderr:==28492==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:17:03.836 INFO:teuthology.orchestra.run.smithi092.stderr:----------------------------------------------------- 2024-09-15T12:17:03.836 INFO:teuthology.orchestra.run.smithi092.stderr:Suppressions used: 2024-09-15T12:17:03.836 INFO:teuthology.orchestra.run.smithi092.stderr: count bytes template 2024-09-15T12:17:03.836 INFO:teuthology.orchestra.run.smithi092.stderr: 1 8 MallocExtension::Register 2024-09-15T12:17:03.836 INFO:teuthology.orchestra.run.smithi092.stderr:----------------------------------------------------- 2024-09-15T12:17:03.836 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-09-15T12:17:03.857 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-15T12:17:03.882 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:17:04.170 INFO:teuthology.orchestra.run.smithi092.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:17:04.171 INFO:teuthology.orchestra.run.smithi092.stderr:INFO 2024-09-15 12:17:04,170 seastar - Reactor backend: linux-aio 2024-09-15T12:17:04.176 INFO:teuthology.orchestra.run.smithi092.stderr:==28678==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:17:04.285 INFO:teuthology.orchestra.run.smithi092.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5fe9b23 0x5fe9de2 0x5fe9fdf 0x5fea2b5 0x60389b3 0x6038bb9 0x5fb8d06 0x5fb923a 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:17:04.285 INFO:teuthology.orchestra.run.smithi092.stderr:kernel callstack: 2024-09-15T12:17:04.301 INFO:teuthology.orchestra.run.smithi092.stderr:INFO 2024-09-15 12:17:04,300 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-15T12:17:04.301 INFO:teuthology.orchestra.run.smithi092.stderr:INFO 2024-09-15 12:17:04,300 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 4-5 2024-09-15T12:17:04.301 INFO:teuthology.orchestra.run.smithi092.stderr:DEBUG 2024-09-15 12:17:04,301 [shard 0:main] seastar - reactor::drain 2024-09-15T12:17:04.818 INFO:teuthology.orchestra.run.smithi092.stderr:----------------------------------------------------- 2024-09-15T12:17:04.818 INFO:teuthology.orchestra.run.smithi092.stderr:Suppressions used: 2024-09-15T12:17:04.818 INFO:teuthology.orchestra.run.smithi092.stderr: count bytes template 2024-09-15T12:17:04.818 INFO:teuthology.orchestra.run.smithi092.stderr: 1 8 MallocExtension::Register 2024-09-15T12:17:04.818 INFO:teuthology.orchestra.run.smithi092.stderr:----------------------------------------------------- 2024-09-15T12:17:04.818 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-09-15T12:17:04.872 INFO:teuthology.orchestra.run.smithi092.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:17:04.876 INFO:teuthology.orchestra.run.smithi092.stderr:INFO 2024-09-15 12:17:04,875 seastar - Reactor backend: linux-aio 2024-09-15T12:17:04.890 INFO:teuthology.orchestra.run.smithi092.stderr:==28676==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:17:09.551 INFO:teuthology.orchestra.run.smithi092.stderr:----------------------------------------------------- 2024-09-15T12:17:09.551 INFO:teuthology.orchestra.run.smithi092.stderr:Suppressions used: 2024-09-15T12:17:09.551 INFO:teuthology.orchestra.run.smithi092.stderr: count bytes template 2024-09-15T12:17:09.551 INFO:teuthology.orchestra.run.smithi092.stderr: 1 8 MallocExtension::Register 2024-09-15T12:17:09.551 INFO:teuthology.orchestra.run.smithi092.stderr:----------------------------------------------------- 2024-09-15T12:17:09.551 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-09-15T12:17:09.573 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-15T12:17:09.597 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-15T12:17:09.597 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:17:09.597 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-15T12:17:09.662 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:17:09.662 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-15T12:17:09.727 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:17:09.727 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-15T12:17:09.790 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:17:09.791 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-15T12:17:09.855 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:17:09.855 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-15T12:17:09.911 INFO:tasks.ceph:Adding keys to all mons... 2024-09-15T12:17:09.911 DEBUG:teuthology.orchestra.run.smithi092:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T12:17:09.975 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.x] 2024-09-15T12:17:09.975 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQAy0OZmn0B1AhAAOPgcvcFVQK43JVPk4zgy1w== 2024-09-15T12:17:09.975 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.0] 2024-09-15T12:17:09.975 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQA10OZmT1uPIxAAW+AfS2CQ5SPeeP4jGHCnIA== 2024-09-15T12:17:09.975 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.1] 2024-09-15T12:17:09.975 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQA70OZmFs8oERAApoDBa+1uEHX3NCOtYlOvyg== 2024-09-15T12:17:09.975 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.2] 2024-09-15T12:17:09.975 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBB0OZm+DEgAhAA4BijgRLrA/68EA1MhUzEJQ== 2024-09-15T12:17:09.975 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2024-09-15T12:17:09.975 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQAy0OZmnOaTBRAAV/HOlHR3WVDJ1/hQIWmI1A== 2024-09-15T12:17:09.976 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T12:17:10.077 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T12:17:10.142 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T12:17:10.203 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T12:17:10.264 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T12:17:10.329 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-15T12:17:10.329 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-15T12:17:10.353 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T12:17:10.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:10.458+0000 7f2295734c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:10.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:10.458+0000 7f2295734c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:10.476 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-15T12:17:10.501 DEBUG:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:17:10.556 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-15T12:17:10.556 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-15T12:17:10.556 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-15T12:17:10.598 INFO:tasks.ceph.mon.a:Started 2024-09-15T12:17:10.598 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-15T12:17:10.599 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-15T12:17:10.599 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-15T12:17:10.601 INFO:tasks.ceph.mgr.x:Started 2024-09-15T12:17:10.601 DEBUG:tasks.ceph:set 0 configs 2024-09-15T12:17:10.601 INFO:tasks.ceph:Setting crush tunables to default 2024-09-15T12:17:10.601 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd crush tunables default 2024-09-15T12:17:10.680 INFO:tasks.ceph.mon.a.smithi092.stderr:2024-09-15T12:17:10.678+0000 7f8c0ead0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:10.680 INFO:tasks.ceph.mon.a.smithi092.stderr:2024-09-15T12:17:10.678+0000 7f8c0ead0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:10.680 INFO:tasks.ceph.mon.a.smithi092.stderr:2024-09-15T12:17:10.678+0000 7f8c0ead0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:10.681 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-09-15T12:17:10.679+0000 7f8737831000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:10.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:10.704+0000 7fe4d2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:10.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:10.714+0000 7fe4d2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:10.785 INFO:teuthology.orchestra.run.smithi092.stderr:adjusted tunables profile to default 2024-09-15T12:17:10.797 INFO:tasks.ceph:check_enable_crimson: True 2024-09-15T12:17:10.797 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-15T12:17:10.797 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-15T12:17:10.886 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-09-15T12:17:10.884+0000 7f8737831000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:10.886 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-09-15T12:17:10.884+0000 7f8737831000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:10.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:10.896+0000 7f4461646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:10.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:10.905+0000 7f4461646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:10.986 INFO:tasks.ceph.mon.a.smithi092.stderr:2024-09-15T12:17:10.984+0000 7f8c057f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-15T12:17:10.986 INFO:tasks.ceph.mon.a.smithi092.stderr:Please be aware that this feature is experimental, untested, 2024-09-15T12:17:10.986 INFO:tasks.ceph.mon.a.smithi092.stderr:unsupported, and may result in data corruption, data loss, 2024-09-15T12:17:10.987 INFO:tasks.ceph.mon.a.smithi092.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-15T12:17:10.987 INFO:tasks.ceph.mon.a.smithi092.stderr:feature with important data. 2024-09-15T12:17:10.987 INFO:tasks.ceph.mon.a.smithi092.stderr: 2024-09-15T12:17:11.799 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-15T12:17:11.799 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:17:11.799 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-15T12:17:11.823 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:17:11.824 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-15T12:17:11.888 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:17:11.888 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-15T12:17:11.953 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 2a0b963b-a469-4a12-beba-0602d3694624 0 2024-09-15T12:17:12.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:12.093+0000 7fa8ebed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:12.103+0000 7fa8ebed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:12.184 INFO:teuthology.orchestra.run.smithi092.stdout:0 2024-09-15T12:17:12.195 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 7bfbf59d-23c0-49e2-beb0-98fd526c5811 1 2024-09-15T12:17:12.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:12.295+0000 7f5d5825c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:12.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:12.305+0000 7f5d5825c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:12.383 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-09-15T12:17:12.395 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 8760d8ef-0dcb-4387-afbd-7d28a18cabce 2 2024-09-15T12:17:12.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:12.496+0000 7fdf2ead1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:12.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:12.505+0000 7fdf2ead1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:12.583 INFO:teuthology.orchestra.run.smithi092.stdout:2 2024-09-15T12:17:12.596 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-15T12:17:12.626 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-15T12:17:12.626 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-15T12:17:12.668 INFO:tasks.ceph.osd.0:Started 2024-09-15T12:17:12.668 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-15T12:17:12.697 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-15T12:17:12.698 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-15T12:17:12.740 INFO:tasks.ceph.osd.1:Started 2024-09-15T12:17:12.741 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-15T12:17:12.771 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-15T12:17:12.771 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-15T12:17:12.813 INFO:tasks.ceph.osd.2:Started 2024-09-15T12:17:12.813 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:17:12.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:12.969+0000 7f0622f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:12.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:12.978+0000 7f0622f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:13.052 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:17:13.052 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":6,"fsid":"b40a72a8-68fe-4cd3-b94d-fb82d50c7882","created":"2024-09-15T12:17:10.700138+0000","modified":"2024-09-15T12:17:12.582420+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T12:17:12.582420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"2a0b963b-a469-4a12-beba-0602d3694624","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7bfbf59d-23c0-49e2-beb0-98fd526c5811","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8760d8ef-0dcb-4387-afbd-7d28a18cabce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:17:13.063 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-15T12:17:13.064 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-15T12:17:13.365 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T12:17:13.467 INFO:teuthology.misc.health.smithi092.stderr:2024-09-15T12:17:13.461+0000 7fe24e351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:13.470 INFO:teuthology.misc.health.smithi092.stderr:2024-09-15T12:17:13.469+0000 7fe24e351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:13.536 INFO:teuthology.misc.health.smithi092.stdout: 2024-09-15T12:17:13.537 INFO:teuthology.misc.health.smithi092.stdout:{"epoch":6,"fsid":"b40a72a8-68fe-4cd3-b94d-fb82d50c7882","created":"2024-09-15T12:17:10.700138+0000","modified":"2024-09-15T12:17:12.582420+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T12:17:12.582420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"2a0b963b-a469-4a12-beba-0602d3694624","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7bfbf59d-23c0-49e2-beb0-98fd526c5811","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8760d8ef-0dcb-4387-afbd-7d28a18cabce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:17:13.547 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-15T12:17:17.529 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-09-15T12:17:17.527+0000 7f86d46e5640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-15T12:17:19.849 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T12:17:19.954 INFO:teuthology.misc.health.smithi092.stderr:2024-09-15T12:17:19.949+0000 7f3669cf4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:19.958 INFO:teuthology.misc.health.smithi092.stderr:2024-09-15T12:17:19.956+0000 7f3669cf4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:20.144 INFO:teuthology.misc.health.smithi092.stdout: 2024-09-15T12:17:20.144 INFO:teuthology.misc.health.smithi092.stdout:{"epoch":7,"fsid":"b40a72a8-68fe-4cd3-b94d-fb82d50c7882","created":"2024-09-15T12:17:10.700138+0000","modified":"2024-09-15T12:17:19.525527+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T12:17:12.582420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"2a0b963b-a469-4a12-beba-0602d3694624","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7bfbf59d-23c0-49e2-beb0-98fd526c5811","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8760d8ef-0dcb-4387-afbd-7d28a18cabce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:17:20.156 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-15T12:17:26.459 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T12:17:26.569 INFO:teuthology.misc.health.smithi092.stderr:2024-09-15T12:17:26.563+0000 7f9923b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:26.573 INFO:teuthology.misc.health.smithi092.stderr:2024-09-15T12:17:26.571+0000 7f9923b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:26.760 INFO:teuthology.misc.health.smithi092.stdout: 2024-09-15T12:17:26.760 INFO:teuthology.misc.health.smithi092.stdout:{"epoch":11,"fsid":"b40a72a8-68fe-4cd3-b94d-fb82d50c7882","created":"2024-09-15T12:17:10.700138+0000","modified":"2024-09-15T12:17:23.535811+0000","last_up_change":"2024-09-15T12:17:20.533134+0000","last_in_change":"2024-09-15T12:17:12.582420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:17:20.544251+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2a0b963b-a469-4a12-beba-0602d3694624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6805","nonce":3819398539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3819398539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":3819398539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3819398539}]},"public_addr":"172.21.15.92:6805/3819398539","cluster_addr":"172.21.15.92:6804/3819398539","heartbeat_back_addr":"172.21.15.92:6809/3819398539","heartbeat_front_addr":"172.21.15.92:6812/3819398539","state":["exists","up"]},{"osd":1,"uuid":"7bfbf59d-23c0-49e2-beb0-98fd526c5811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6803","nonce":950917640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":950917640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":950917640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6811","nonce":950917640}]},"public_addr":"172.21.15.92:6803/950917640","cluster_addr":"172.21.15.92:6802/950917640","heartbeat_back_addr":"172.21.15.92:6810/950917640","heartbeat_front_addr":"172.21.15.92:6811/950917640","state":["exists","up"]},{"osd":2,"uuid":"8760d8ef-0dcb-4387-afbd-7d28a18cabce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2494303087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6807","nonce":2494303087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2494303087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":2494303087}]},"public_addr":"172.21.15.92:6806/2494303087","cluster_addr":"172.21.15.92:6807/2494303087","heartbeat_back_addr":"172.21.15.92:6814/2494303087","heartbeat_front_addr":"172.21.15.92:6813/2494303087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:17:26.772 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-15T12:17:26.772 INFO:tasks.ceph:Creating RBD pool 2024-09-15T12:17:26.772 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-15T12:17:26.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:26.871+0000 7f7360551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:26.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:26.882+0000 7f7360551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:27.816 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'rbd' created 2024-09-15T12:17:27.836 DEBUG:teuthology.orchestra.run.smithi092:> rbd --cluster ceph pool init rbd 2024-09-15T12:17:27.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:27.933+0000 7f9d6814dac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:27.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:27.934+0000 7f9d6814dac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:27.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:27.938+0000 7f9d6814dac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:30.875 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-15T12:17:30.875 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-15T12:17:30.876 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-15T12:17:30.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:30.980+0000 7fcd1e874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:30.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:30.989+0000 7fcd1e874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:31.180 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:17:31.193 INFO:teuthology.orchestra.run.smithi092.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-15T12:17:31.194 INFO:tasks.ceph_manager:config epoch is 1 2024-09-15T12:17:31.194 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T12:17:31.194 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-15T12:17:31.194 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-15T12:17:31.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:31.297+0000 7fbfe3111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:31.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:31.304+0000 7fbfe3111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:31.539 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:17:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3437509077},{"type":"v1","addr":"172.21.15.92:6801","nonce":3437509077}]},"active_addr":"172.21.15.92:6801/3437509077","active_change":"2024-09-15T12:17:16.519531+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":4265000264}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":891938272}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":273950686}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":3122683354}]}]} 2024-09-15T12:17:31.554 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-15T12:17:31.554 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-15T12:17:31.554 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:17:31.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:31.658+0000 7efee5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:31.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:31.665+0000 7efee5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:31.855 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:17:31.855 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":15,"fsid":"b40a72a8-68fe-4cd3-b94d-fb82d50c7882","created":"2024-09-15T12:17:10.700138+0000","modified":"2024-09-15T12:17:30.830517+0000","last_up_change":"2024-09-15T12:17:20.533134+0000","last_in_change":"2024-09-15T12:17:12.582420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:17:20.544251+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T12:17:27.071454+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2a0b963b-a469-4a12-beba-0602d3694624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6805","nonce":3819398539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3819398539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":3819398539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3819398539}]},"public_addr":"172.21.15.92:6805/3819398539","cluster_addr":"172.21.15.92:6804/3819398539","heartbeat_back_addr":"172.21.15.92:6809/3819398539","heartbeat_front_addr":"172.21.15.92:6812/3819398539","state":["exists","up"]},{"osd":1,"uuid":"7bfbf59d-23c0-49e2-beb0-98fd526c5811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6803","nonce":950917640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":950917640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":950917640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6811","nonce":950917640}]},"public_addr":"172.21.15.92:6803/950917640","cluster_addr":"172.21.15.92:6802/950917640","heartbeat_back_addr":"172.21.15.92:6810/950917640","heartbeat_front_addr":"172.21.15.92:6811/950917640","state":["exists","up"]},{"osd":2,"uuid":"8760d8ef-0dcb-4387-afbd-7d28a18cabce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2494303087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6807","nonce":2494303087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2494303087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":2494303087}]},"public_addr":"172.21.15.92:6806/2494303087","cluster_addr":"172.21.15.92:6807/2494303087","heartbeat_back_addr":"172.21.15.92:6814/2494303087","heartbeat_front_addr":"172.21.15.92:6813/2494303087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:17:31.868 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-15T12:17:31.868 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:17:31.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:31.969+0000 7fec69711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:31.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:31.977+0000 7fec69711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:32.165 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:17:32.165 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":15,"fsid":"b40a72a8-68fe-4cd3-b94d-fb82d50c7882","created":"2024-09-15T12:17:10.700138+0000","modified":"2024-09-15T12:17:30.830517+0000","last_up_change":"2024-09-15T12:17:20.533134+0000","last_in_change":"2024-09-15T12:17:12.582420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:17:20.544251+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T12:17:27.071454+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2a0b963b-a469-4a12-beba-0602d3694624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6805","nonce":3819398539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3819398539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":3819398539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3819398539}]},"public_addr":"172.21.15.92:6805/3819398539","cluster_addr":"172.21.15.92:6804/3819398539","heartbeat_back_addr":"172.21.15.92:6809/3819398539","heartbeat_front_addr":"172.21.15.92:6812/3819398539","state":["exists","up"]},{"osd":1,"uuid":"7bfbf59d-23c0-49e2-beb0-98fd526c5811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6803","nonce":950917640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":950917640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":950917640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6811","nonce":950917640}]},"public_addr":"172.21.15.92:6803/950917640","cluster_addr":"172.21.15.92:6802/950917640","heartbeat_back_addr":"172.21.15.92:6810/950917640","heartbeat_front_addr":"172.21.15.92:6811/950917640","state":["exists","up"]},{"osd":2,"uuid":"8760d8ef-0dcb-4387-afbd-7d28a18cabce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2494303087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6807","nonce":2494303087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2494303087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":2494303087}]},"public_addr":"172.21.15.92:6806/2494303087","cluster_addr":"172.21.15.92:6807/2494303087","heartbeat_back_addr":"172.21.15.92:6814/2494303087","heartbeat_front_addr":"172.21.15.92:6813/2494303087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:17:32.179 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-15T12:17:32.180 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-15T12:17:32.180 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-15T12:17:32.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:32.287+0000 7f958b911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:32.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:32.287+0000 7fbaf7eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:32.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:32.287+0000 7fb850191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:32.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:32.297+0000 7fbaf7eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:32.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:32.297+0000 7fb850191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:32.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:32.298+0000 7f958b911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:32.331 INFO:teuthology.orchestra.run.smithi092.stdout:34359738379 2024-09-15T12:17:32.331 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T12:17:32.332 INFO:teuthology.orchestra.run.smithi092.stdout:34359738379 2024-09-15T12:17:32.332 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T12:17:32.334 INFO:teuthology.orchestra.run.smithi092.stdout:34359738379 2024-09-15T12:17:32.334 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T12:17:32.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:32.439+0000 7f0e26ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:32.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:32.450+0000 7f0e26ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:32.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:32.482+0000 7f6f82351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:32.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:32.484+0000 7ffbf8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:32.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:32.491+0000 7f6f82351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:32.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:32.494+0000 7ffbf8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:32.655 INFO:teuthology.orchestra.run.smithi092.stdout:34359738379 2024-09-15T12:17:32.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738379 got 34359738379 for osd.0 2024-09-15T12:17:32.669 DEBUG:teuthology.parallel:result is None 2024-09-15T12:17:32.691 INFO:teuthology.orchestra.run.smithi092.stdout:34359738379 2024-09-15T12:17:32.697 INFO:teuthology.orchestra.run.smithi092.stdout:34359738379 2024-09-15T12:17:32.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738379 got 34359738379 for osd.2 2024-09-15T12:17:32.705 DEBUG:teuthology.parallel:result is None 2024-09-15T12:17:32.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738379 got 34359738379 for osd.1 2024-09-15T12:17:32.711 DEBUG:teuthology.parallel:result is None 2024-09-15T12:17:32.711 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T12:17:32.711 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:17:32.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:32.857+0000 7effe0657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:32.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:32.864+0000 7effe0657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:33.049 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:17:33.049 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-15T12:17:33.062 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-09-15T12:17:32.524838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":80996,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283034524,"statfs":{"total":289910292480,"available":289827352576,"internally_reserved":0,"allocated":512000,"data_stored":1276210,"data_compressed":60094,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.204818"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.848965+0000","last_change":"2024-09-15T12:17:30.855365+0000","last_active":"2024-09-15T12:17:30.848965+0000","last_peered":"2024-09-15T12:17:30.848965+0000","last_clean":"2024-09-15T12:17:30.848965+0000","last_became_active":"2024-09-15T12:17:28.924258+0000","last_became_peered":"2024-09-15T12:17:28.924258+0000","last_unstale":"2024-09-15T12:17:30.848965+0000","last_undegraded":"2024-09-15T12:17:30.848965+0000","last_fullsized":"2024-09-15T12:17:30.848965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.854677+0000","last_change":"2024-09-15T12:17:30.859678+0000","last_active":"2024-09-15T12:17:30.854677+0000","last_peered":"2024-09-15T12:17:30.854677+0000","last_clean":"2024-09-15T12:17:30.854677+0000","last_became_active":"2024-09-15T12:17:28.953744+0000","last_became_peered":"2024-09-15T12:17:28.953744+0000","last_unstale":"2024-09-15T12:17:30.854677+0000","last_undegraded":"2024-09-15T12:17:30.854677+0000","last_fullsized":"2024-09-15T12:17:30.854677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.847136+0000","last_change":"2024-09-15T12:17:30.855158+0000","last_active":"2024-09-15T12:17:30.847136+0000","last_peered":"2024-09-15T12:17:30.847136+0000","last_clean":"2024-09-15T12:17:30.847136+0000","last_became_active":"2024-09-15T12:17:28.934272+0000","last_became_peered":"2024-09-15T12:17:28.934272+0000","last_unstale":"2024-09-15T12:17:30.847136+0000","last_undegraded":"2024-09-15T12:17:30.847136+0000","last_fullsized":"2024-09-15T12:17:30.847136+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.846381+0000","last_change":"2024-09-15T12:17:30.854853+0000","last_active":"2024-09-15T12:17:30.846381+0000","last_peered":"2024-09-15T12:17:30.846381+0000","last_clean":"2024-09-15T12:17:30.846381+0000","last_became_active":"2024-09-15T12:17:28.906861+0000","last_became_peered":"2024-09-15T12:17:28.906861+0000","last_unstale":"2024-09-15T12:17:30.846381+0000","last_undegraded":"2024-09-15T12:17:30.846381+0000","last_fullsized":"2024-09-15T12:17:30.846381+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.855086+0000","last_change":"2024-09-15T12:17:30.855086+0000","last_active":"2024-09-15T12:17:30.855086+0000","last_peered":"2024-09-15T12:17:30.855086+0000","last_clean":"2024-09-15T12:17:30.855086+0000","last_became_active":"2024-09-15T12:17:28.912738+0000","last_became_peered":"2024-09-15T12:17:28.912738+0000","last_unstale":"2024-09-15T12:17:30.855086+0000","last_undegraded":"2024-09-15T12:17:30.855086+0000","last_fullsized":"2024-09-15T12:17:30.855086+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.851070+0000","last_change":"2024-09-15T12:17:30.853570+0000","last_active":"2024-09-15T12:17:30.851070+0000","last_peered":"2024-09-15T12:17:30.851070+0000","last_clean":"2024-09-15T12:17:30.851070+0000","last_became_active":"2024-09-15T12:17:28.942066+0000","last_became_peered":"2024-09-15T12:17:28.942066+0000","last_unstale":"2024-09-15T12:17:30.851070+0000","last_undegraded":"2024-09-15T12:17:30.851070+0000","last_fullsized":"2024-09-15T12:17:30.851070+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.845998+0000","last_change":"2024-09-15T12:17:30.849969+0000","last_active":"2024-09-15T12:17:30.845998+0000","last_peered":"2024-09-15T12:17:30.845998+0000","last_clean":"2024-09-15T12:17:30.845998+0000","last_became_active":"2024-09-15T12:17:28.906828+0000","last_became_peered":"2024-09-15T12:17:28.906828+0000","last_unstale":"2024-09-15T12:17:30.845998+0000","last_undegraded":"2024-09-15T12:17:30.845998+0000","last_fullsized":"2024-09-15T12:17:30.845998+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.855493+0000","last_change":"2024-09-15T12:17:30.859057+0000","last_active":"2024-09-15T12:17:30.855493+0000","last_peered":"2024-09-15T12:17:30.855493+0000","last_clean":"2024-09-15T12:17:30.855493+0000","last_became_active":"2024-09-15T12:17:28.912555+0000","last_became_peered":"2024-09-15T12:17:28.912555+0000","last_unstale":"2024-09-15T12:17:30.855493+0000","last_undegraded":"2024-09-15T12:17:30.855493+0000","last_fullsized":"2024-09-15T12:17:30.855493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":90,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.850278+0000","last_change":"2024-09-15T12:17:22.585730+0000","last_active":"2024-09-15T12:17:30.850278+0000","last_peered":"2024-09-15T12:17:30.850278+0000","last_clean":"2024-09-15T12:17:30.850278+0000","last_became_active":"2024-09-15T12:17:22.575804+0000","last_became_peered":"2024-09-15T12:17:22.575804+0000","last_unstale":"2024-09-15T12:17:30.850278+0000","last_undegraded":"2024-09-15T12:17:30.850278+0000","last_fullsized":"2024-09-15T12:17:30.850278+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:21.533890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:21.533890+0000","last_clean_scrub_stamp":"2024-09-15T12:17:21.533890+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26956,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344884,"statfs":{"total":96636764160,"available":96609161216,"internally_reserved":0,"allocated":126976,"data_stored":31812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":622199,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":622199,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:17:33.063 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:17:33.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:33.166+0000 7f81e0f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:33.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:33.173+0000 7f81e0f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:33.360 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:17:33.360 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-15T12:17:33.373 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-09-15T12:17:32.524838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":80996,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283034524,"statfs":{"total":289910292480,"available":289827352576,"internally_reserved":0,"allocated":512000,"data_stored":1276210,"data_compressed":60094,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.204818"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.848965+0000","last_change":"2024-09-15T12:17:30.855365+0000","last_active":"2024-09-15T12:17:30.848965+0000","last_peered":"2024-09-15T12:17:30.848965+0000","last_clean":"2024-09-15T12:17:30.848965+0000","last_became_active":"2024-09-15T12:17:28.924258+0000","last_became_peered":"2024-09-15T12:17:28.924258+0000","last_unstale":"2024-09-15T12:17:30.848965+0000","last_undegraded":"2024-09-15T12:17:30.848965+0000","last_fullsized":"2024-09-15T12:17:30.848965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.854677+0000","last_change":"2024-09-15T12:17:30.859678+0000","last_active":"2024-09-15T12:17:30.854677+0000","last_peered":"2024-09-15T12:17:30.854677+0000","last_clean":"2024-09-15T12:17:30.854677+0000","last_became_active":"2024-09-15T12:17:28.953744+0000","last_became_peered":"2024-09-15T12:17:28.953744+0000","last_unstale":"2024-09-15T12:17:30.854677+0000","last_undegraded":"2024-09-15T12:17:30.854677+0000","last_fullsized":"2024-09-15T12:17:30.854677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.847136+0000","last_change":"2024-09-15T12:17:30.855158+0000","last_active":"2024-09-15T12:17:30.847136+0000","last_peered":"2024-09-15T12:17:30.847136+0000","last_clean":"2024-09-15T12:17:30.847136+0000","last_became_active":"2024-09-15T12:17:28.934272+0000","last_became_peered":"2024-09-15T12:17:28.934272+0000","last_unstale":"2024-09-15T12:17:30.847136+0000","last_undegraded":"2024-09-15T12:17:30.847136+0000","last_fullsized":"2024-09-15T12:17:30.847136+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.846381+0000","last_change":"2024-09-15T12:17:30.854853+0000","last_active":"2024-09-15T12:17:30.846381+0000","last_peered":"2024-09-15T12:17:30.846381+0000","last_clean":"2024-09-15T12:17:30.846381+0000","last_became_active":"2024-09-15T12:17:28.906861+0000","last_became_peered":"2024-09-15T12:17:28.906861+0000","last_unstale":"2024-09-15T12:17:30.846381+0000","last_undegraded":"2024-09-15T12:17:30.846381+0000","last_fullsized":"2024-09-15T12:17:30.846381+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.855086+0000","last_change":"2024-09-15T12:17:30.855086+0000","last_active":"2024-09-15T12:17:30.855086+0000","last_peered":"2024-09-15T12:17:30.855086+0000","last_clean":"2024-09-15T12:17:30.855086+0000","last_became_active":"2024-09-15T12:17:28.912738+0000","last_became_peered":"2024-09-15T12:17:28.912738+0000","last_unstale":"2024-09-15T12:17:30.855086+0000","last_undegraded":"2024-09-15T12:17:30.855086+0000","last_fullsized":"2024-09-15T12:17:30.855086+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.851070+0000","last_change":"2024-09-15T12:17:30.853570+0000","last_active":"2024-09-15T12:17:30.851070+0000","last_peered":"2024-09-15T12:17:30.851070+0000","last_clean":"2024-09-15T12:17:30.851070+0000","last_became_active":"2024-09-15T12:17:28.942066+0000","last_became_peered":"2024-09-15T12:17:28.942066+0000","last_unstale":"2024-09-15T12:17:30.851070+0000","last_undegraded":"2024-09-15T12:17:30.851070+0000","last_fullsized":"2024-09-15T12:17:30.851070+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.845998+0000","last_change":"2024-09-15T12:17:30.849969+0000","last_active":"2024-09-15T12:17:30.845998+0000","last_peered":"2024-09-15T12:17:30.845998+0000","last_clean":"2024-09-15T12:17:30.845998+0000","last_became_active":"2024-09-15T12:17:28.906828+0000","last_became_peered":"2024-09-15T12:17:28.906828+0000","last_unstale":"2024-09-15T12:17:30.845998+0000","last_undegraded":"2024-09-15T12:17:30.845998+0000","last_fullsized":"2024-09-15T12:17:30.845998+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.855493+0000","last_change":"2024-09-15T12:17:30.859057+0000","last_active":"2024-09-15T12:17:30.855493+0000","last_peered":"2024-09-15T12:17:30.855493+0000","last_clean":"2024-09-15T12:17:30.855493+0000","last_became_active":"2024-09-15T12:17:28.912555+0000","last_became_peered":"2024-09-15T12:17:28.912555+0000","last_unstale":"2024-09-15T12:17:30.855493+0000","last_undegraded":"2024-09-15T12:17:30.855493+0000","last_fullsized":"2024-09-15T12:17:30.855493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":90,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:17:30.850278+0000","last_change":"2024-09-15T12:17:22.585730+0000","last_active":"2024-09-15T12:17:30.850278+0000","last_peered":"2024-09-15T12:17:30.850278+0000","last_clean":"2024-09-15T12:17:30.850278+0000","last_became_active":"2024-09-15T12:17:22.575804+0000","last_became_peered":"2024-09-15T12:17:22.575804+0000","last_unstale":"2024-09-15T12:17:30.850278+0000","last_undegraded":"2024-09-15T12:17:30.850278+0000","last_fullsized":"2024-09-15T12:17:30.850278+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:21.533890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:21.533890+0000","last_clean_scrub_stamp":"2024-09-15T12:17:21.533890+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26956,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344884,"statfs":{"total":96636764160,"available":96609161216,"internally_reserved":0,"allocated":126976,"data_stored":31812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":622199,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":622199,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:17:33.374 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T12:17:33.374 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T12:17:33.374 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-15T12:17:33.374 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-15T12:17:33.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:33.477+0000 7faa64e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:33.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:17:33.483+0000 7faa64e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:17:33.706 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:17:33.706 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T12:17:33.720 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-15T12:17:33.720 INFO:teuthology.run_tasks:Running task workunit... 2024-09-15T12:17:33.734 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-15T12:17:33.734 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-15T12:17:33.735 DEBUG:teuthology.orchestra.run.smithi092:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-15T12:17:33.750 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:17:33.750 INFO:teuthology.orchestra.run.smithi092.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-15T12:17:33.750 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-15T12:17:33.806 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-15T12:17:33.806 DEBUG:teuthology.orchestra.run.smithi092:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-15T12:17:33.862 INFO:tasks.workunit:timeout=3h 2024-09-15T12:17:33.862 INFO:tasks.workunit:cleanup=True 2024-09-15T12:17:33.862 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-15T12:17:33.918 INFO:tasks.workunit.client.0.smithi092.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-15T12:18:25.644 INFO:tasks.workunit.client.0.smithi092.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-09-15T12:18:25.645 INFO:tasks.workunit.client.0.smithi092.stderr: 2024-09-15T12:18:25.645 INFO:tasks.workunit.client.0.smithi092.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-15T12:18:25.645 INFO:tasks.workunit.client.0.smithi092.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-15T12:18:25.645 INFO:tasks.workunit.client.0.smithi092.stderr:state without impacting any branches by switching back to a branch. 2024-09-15T12:18:25.645 INFO:tasks.workunit.client.0.smithi092.stderr: 2024-09-15T12:18:25.645 INFO:tasks.workunit.client.0.smithi092.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-15T12:18:25.645 INFO:tasks.workunit.client.0.smithi092.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-15T12:18:25.645 INFO:tasks.workunit.client.0.smithi092.stderr: 2024-09-15T12:18:25.646 INFO:tasks.workunit.client.0.smithi092.stderr: git switch -c 2024-09-15T12:18:25.646 INFO:tasks.workunit.client.0.smithi092.stderr: 2024-09-15T12:18:25.646 INFO:tasks.workunit.client.0.smithi092.stderr:Or undo this operation with: 2024-09-15T12:18:25.646 INFO:tasks.workunit.client.0.smithi092.stderr: 2024-09-15T12:18:25.646 INFO:tasks.workunit.client.0.smithi092.stderr: git switch - 2024-09-15T12:18:25.646 INFO:tasks.workunit.client.0.smithi092.stderr: 2024-09-15T12:18:25.646 INFO:tasks.workunit.client.0.smithi092.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-15T12:18:25.646 INFO:tasks.workunit.client.0.smithi092.stderr: 2024-09-15T12:18:25.646 INFO:tasks.workunit.client.0.smithi092.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-09-15T12:18:25.648 DEBUG:teuthology.orchestra.run.smithi092:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-15T12:18:25.830 INFO:tasks.workunit.client.0.smithi092.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-15T12:18:25.832 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T12:18:25.832 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-15T12:18:26.452 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-15T12:18:26.527 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-15T12:18:26.567 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T12:18:26.569 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T12:18:26.569 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-15T12:18:26.607 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T12:18:26.611 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-15T12:18:26.611 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-15T12:18:26.627 INFO:tasks.workunit:Running workunits matching rbd/crimson/test_crimson_librbd.sh on client.0... 2024-09-15T12:18:26.628 INFO:tasks.workunit:Running workunit rbd/crimson/test_crimson_librbd.sh... 2024-09-15T12:18:26.628 DEBUG:teuthology.orchestra.run.smithi092:workunit test rbd/crimson/test_crimson_librbd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh 2024-09-15T12:18:26.733 INFO:tasks.workunit.client.0.smithi092.stdout:seed 30987 2024-09-15T12:18:26.734 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = TestLibRBD.* 2024-09-15T12:18:26.734 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 171 tests from 1 test suite. 2024-09-15T12:18:26.734 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:18:26.734 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 171 tests from TestLibRBD 2024-09-15T12:18:26.780 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.CreateAndStat 2024-09-15T12:18:27.886 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:30.013 INFO:tasks.workunit.client.0.smithi092.stdout:image has size 2097152 and order 22 2024-09-15T12:18:30.013 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.CreateAndStat (3233 ms) 2024-09-15T12:18:30.014 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.CreateWithSameDataPool 2024-09-15T12:18:30.014 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:780: Skipped 2024-09-15T12:18:30.014 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:18:30.014 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.CreateWithSameDataPool (0 ms) 2024-09-15T12:18:30.014 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.CreateAndStatPP 2024-09-15T12:18:30.014 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:30.100 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.CreateAndStatPP (86 ms) 2024-09-15T12:18:30.100 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.GetId 2024-09-15T12:18:30.100 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:30.186 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.GetId (87 ms) 2024-09-15T12:18:30.186 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.GetIdPP 2024-09-15T12:18:30.187 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:30.278 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.GetIdPP (91 ms) 2024-09-15T12:18:30.278 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefix 2024-09-15T12:18:30.278 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:30.363 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.GetBlockNamePrefix (85 ms) 2024-09-15T12:18:30.363 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefixPP 2024-09-15T12:18:30.363 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:30.445 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.GetBlockNamePrefixPP (82 ms) 2024-09-15T12:18:30.446 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestGetCreateTimestamp 2024-09-15T12:18:30.446 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:939: Skipped 2024-09-15T12:18:30.446 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:18:30.446 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestGetCreateTimestamp (0 ms) 2024-09-15T12:18:30.446 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.GetCreateTimestampPP 2024-09-15T12:18:30.446 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:962: Skipped 2024-09-15T12:18:30.446 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:18:30.446 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.GetCreateTimestampPP (0 ms) 2024-09-15T12:18:30.446 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.OpenAio 2024-09-15T12:18:30.446 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:30.531 INFO:tasks.workunit.client.0.smithi092.stdout:image has size 2097152 and order 22 2024-09-15T12:18:30.531 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.OpenAio (85 ms) 2024-09-15T12:18:30.531 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.OpenAioFail 2024-09-15T12:18:30.542 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.OpenAioFail (11 ms) 2024-09-15T12:18:30.542 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.OpenAioPP 2024-09-15T12:18:30.542 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:30.681 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.OpenAioPP (139 ms) 2024-09-15T12:18:30.681 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.OpenAioFailPP 2024-09-15T12:18:30.692 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.OpenAioFailPP (12 ms) 2024-09-15T12:18:30.693 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ResizeAndStat 2024-09-15T12:18:30.693 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:30.904 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.ResizeAndStat (211 ms) 2024-09-15T12:18:30.904 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ResizeAndStatPP 2024-09-15T12:18:30.904 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:31.063 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.ResizeAndStatPP (159 ms) 2024-09-15T12:18:31.063 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResize 2024-09-15T12:18:31.063 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:31.258 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.UpdateWatchAndResize (195 ms) 2024-09-15T12:18:31.258 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResizePP 2024-09-15T12:18:31.258 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:31.459 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.UpdateWatchAndResizePP (201 ms) 2024-09-15T12:18:31.459 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCreateLsDelete 2024-09-15T12:18:33.211 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:35.017 INFO:tasks.workunit.client.0.smithi092.stdout:image: image15 2024-09-15T12:18:35.017 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image15 2024-09-15T12:18:35.017 INFO:tasks.workunit.client.0.smithi092.stdout:found image15 2024-09-15T12:18:35.017 INFO:tasks.workunit.client.0.smithi092.stdout:erased image15 2024-09-15T12:18:35.017 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:35.250 INFO:tasks.workunit.client.0.smithi092.stdout:image: image15 2024-09-15T12:18:35.250 INFO:tasks.workunit.client.0.smithi092.stdout:image: image16 2024-09-15T12:18:35.250 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image15 2024-09-15T12:18:35.250 INFO:tasks.workunit.client.0.smithi092.stdout:found image15 2024-09-15T12:18:35.250 INFO:tasks.workunit.client.0.smithi092.stdout:erased image15 2024-09-15T12:18:35.251 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image16 2024-09-15T12:18:35.251 INFO:tasks.workunit.client.0.smithi092.stdout:found image16 2024-09-15T12:18:35.251 INFO:tasks.workunit.client.0.smithi092.stdout:erased image16 2024-09-15T12:18:35.251 INFO:tasks.workunit.client.0.smithi092.stdout:image: image16 2024-09-15T12:18:35.251 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image16 2024-09-15T12:18:35.251 INFO:tasks.workunit.client.0.smithi092.stdout:found image16 2024-09-15T12:18:35.251 INFO:tasks.workunit.client.0.smithi092.stdout:erased image16 2024-09-15T12:18:35.251 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCreateLsDelete (3791 ms) 2024-09-15T12:18:35.251 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCreateLsDeletePP 2024-09-15T12:18:36.926 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:39.067 INFO:tasks.workunit.client.0.smithi092.stdout:num images is: 1 2024-09-15T12:18:39.067 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 1 2024-09-15T12:18:39.067 INFO:tasks.workunit.client.0.smithi092.stdout:image: image17 2024-09-15T12:18:39.067 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image17 2024-09-15T12:18:39.067 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:39.116 INFO:tasks.workunit.client.0.smithi092.stdout:num images is: 2 2024-09-15T12:18:39.116 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 2 2024-09-15T12:18:39.116 INFO:tasks.workunit.client.0.smithi092.stdout:image: image17 2024-09-15T12:18:39.116 INFO:tasks.workunit.client.0.smithi092.stdout:image: image18 2024-09-15T12:18:39.116 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image17 2024-09-15T12:18:39.117 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image18 2024-09-15T12:18:39.222 INFO:tasks.workunit.client.0.smithi092.stdout:num images is: 1 2024-09-15T12:18:39.222 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 1 2024-09-15T12:18:39.222 INFO:tasks.workunit.client.0.smithi092.stdout:image: image18 2024-09-15T12:18:39.222 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image18 2024-09-15T12:18:39.222 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCreateLsDeletePP (3972 ms) 2024-09-15T12:18:39.223 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCopy 2024-09-15T12:18:40.958 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:48.391 INFO:tasks.workunit.client.0.smithi092.stdout:image: image19 2024-09-15T12:18:48.391 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image19 2024-09-15T12:18:48.392 INFO:tasks.workunit.client.0.smithi092.stdout:found image19 2024-09-15T12:18:48.392 INFO:tasks.workunit.client.0.smithi092.stdout:erased image19 2024-09-15T12:18:48.392 INFO:tasks.workunit.client.0.smithi092.stdout:image: image19 2024-09-15T12:18:48.392 INFO:tasks.workunit.client.0.smithi092.stdout:image: image20 2024-09-15T12:18:48.392 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image19 2024-09-15T12:18:48.392 INFO:tasks.workunit.client.0.smithi092.stdout:found image19 2024-09-15T12:18:48.392 INFO:tasks.workunit.client.0.smithi092.stdout:erased image19 2024-09-15T12:18:48.392 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image20 2024-09-15T12:18:48.392 INFO:tasks.workunit.client.0.smithi092.stdout:found image20 2024-09-15T12:18:48.392 INFO:tasks.workunit.client.0.smithi092.stdout:erased image20 2024-09-15T12:18:48.392 INFO:tasks.workunit.client.0.smithi092.stdout:0.00% done 2024-09-15T12:18:48.392 INFO:tasks.workunit.client.0.smithi092.stdout:100.00% done 2024-09-15T12:18:48.393 INFO:tasks.workunit.client.0.smithi092.stdout:image: image19 2024-09-15T12:18:48.393 INFO:tasks.workunit.client.0.smithi092.stdout:image: image20 2024-09-15T12:18:48.393 INFO:tasks.workunit.client.0.smithi092.stdout:image: image21 2024-09-15T12:18:48.393 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image19 2024-09-15T12:18:48.393 INFO:tasks.workunit.client.0.smithi092.stdout:found image19 2024-09-15T12:18:48.393 INFO:tasks.workunit.client.0.smithi092.stdout:erased image19 2024-09-15T12:18:48.393 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image20 2024-09-15T12:18:48.393 INFO:tasks.workunit.client.0.smithi092.stdout:found image20 2024-09-15T12:18:48.393 INFO:tasks.workunit.client.0.smithi092.stdout:erased image20 2024-09-15T12:18:48.393 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image21 2024-09-15T12:18:48.393 INFO:tasks.workunit.client.0.smithi092.stdout:found image21 2024-09-15T12:18:48.393 INFO:tasks.workunit.client.0.smithi092.stdout:erased image21 2024-09-15T12:18:48.393 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCopy (9170 ms) 2024-09-15T12:18:48.393 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCopyPP 2024-09-15T12:18:49.998 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:18:54.642 INFO:tasks.workunit.client.0.smithi092.stdout:num images is: 1 2024-09-15T12:18:54.642 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 1 2024-09-15T12:18:54.642 INFO:tasks.workunit.client.0.smithi092.stdout:image: image22 2024-09-15T12:18:54.642 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image22 2024-09-15T12:18:56.950 INFO:tasks.workunit.client.0.smithi092.stdout:num images is: 2 2024-09-15T12:18:56.950 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 2 2024-09-15T12:18:56.950 INFO:tasks.workunit.client.0.smithi092.stdout:image: image22 2024-09-15T12:18:56.950 INFO:tasks.workunit.client.0.smithi092.stdout:image: image23 2024-09-15T12:18:56.950 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image22 2024-09-15T12:18:56.951 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image23 2024-09-15T12:18:57.692 INFO:tasks.workunit.client.0.smithi092.stdout:0.00% done 2024-09-15T12:18:57.693 INFO:tasks.workunit.client.0.smithi092.stdout:100.00% done 2024-09-15T12:18:57.693 INFO:tasks.workunit.client.0.smithi092.stdout:num images is: 3 2024-09-15T12:18:57.693 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 3 2024-09-15T12:18:57.693 INFO:tasks.workunit.client.0.smithi092.stdout:image: image22 2024-09-15T12:18:57.693 INFO:tasks.workunit.client.0.smithi092.stdout:image: image23 2024-09-15T12:18:57.693 INFO:tasks.workunit.client.0.smithi092.stdout:image: image24 2024-09-15T12:18:57.693 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image22 2024-09-15T12:18:57.693 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image23 2024-09-15T12:18:57.693 INFO:tasks.workunit.client.0.smithi092.stdout:expected = image24 2024-09-15T12:18:58.161 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCopyPP (9770 ms) 2024-09-15T12:18:58.162 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestDeepCopy 2024-09-15T12:18:58.162 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:1578: Skipped 2024-09-15T12:18:58.162 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:18:58.162 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopy (0 ms) 2024-09-15T12:18:58.162 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestDeepCopyPP 2024-09-15T12:18:58.162 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:1745: Skipped 2024-09-15T12:18:58.162 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:18:58.162 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopyPP (0 ms) 2024-09-15T12:18:58.162 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnap 2024-09-15T12:18:58.162 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:19:01.868 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 1 2024-09-15T12:19:01.868 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 1 2024-09-15T12:19:01.868 INFO:tasks.workunit.client.0.smithi092.stdout:snap: snap1 2024-09-15T12:19:01.868 INFO:tasks.workunit.client.0.smithi092.stdout:found snap1 with size 2097152 2024-09-15T12:19:01.868 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 2 2024-09-15T12:19:01.868 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 2 2024-09-15T12:19:01.869 INFO:tasks.workunit.client.0.smithi092.stdout:snap: snap1 2024-09-15T12:19:01.869 INFO:tasks.workunit.client.0.smithi092.stdout:snap: snap2 2024-09-15T12:19:01.869 INFO:tasks.workunit.client.0.smithi092.stdout:found snap1 with size 2097152 2024-09-15T12:19:01.869 INFO:tasks.workunit.client.0.smithi092.stdout:found snap2 with size 4194304 2024-09-15T12:19:01.869 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 1 2024-09-15T12:19:01.869 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 1 2024-09-15T12:19:01.869 INFO:tasks.workunit.client.0.smithi092.stdout:snap: snap2 2024-09-15T12:19:01.869 INFO:tasks.workunit.client.0.smithi092.stdout:found snap2 with size 4194304 2024-09-15T12:19:01.869 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 0 2024-09-15T12:19:01.869 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 0 2024-09-15T12:19:01.869 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnap (3706 ms) 2024-09-15T12:19:01.869 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestGetSnapShotTimeStamp 2024-09-15T12:19:01.869 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:1890: Skipped 2024-09-15T12:19:01.869 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:19:01.870 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestGetSnapShotTimeStamp (0 ms) 2024-09-15T12:19:01.870 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnapPP 2024-09-15T12:19:01.870 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:19:02.866 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 1 2024-09-15T12:19:02.866 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 1 2024-09-15T12:19:02.866 INFO:tasks.workunit.client.0.smithi092.stdout:snap: snap1 2024-09-15T12:19:02.866 INFO:tasks.workunit.client.0.smithi092.stdout:found snap1 with size 2097152 2024-09-15T12:19:03.861 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 2 2024-09-15T12:19:03.861 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 2 2024-09-15T12:19:03.861 INFO:tasks.workunit.client.0.smithi092.stdout:snap: snap1 2024-09-15T12:19:03.861 INFO:tasks.workunit.client.0.smithi092.stdout:snap: snap2 2024-09-15T12:19:03.861 INFO:tasks.workunit.client.0.smithi092.stdout:found snap1 with size 2097152 2024-09-15T12:19:03.861 INFO:tasks.workunit.client.0.smithi092.stdout:found snap2 with size 4194304 2024-09-15T12:19:04.878 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 1 2024-09-15T12:19:04.878 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 1 2024-09-15T12:19:04.878 INFO:tasks.workunit.client.0.smithi092.stdout:snap: snap2 2024-09-15T12:19:04.878 INFO:tasks.workunit.client.0.smithi092.stdout:found snap2 with size 4194304 2024-09-15T12:19:05.880 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 0 2024-09-15T12:19:05.881 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 0 2024-09-15T12:19:05.894 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnapPP (4026 ms) 2024-09-15T12:19:05.894 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestGetNameIdSnapPP 2024-09-15T12:19:05.894 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:19:11.886 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 0 2024-09-15T12:19:11.886 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 0 2024-09-15T12:19:11.898 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestGetNameIdSnapPP (6004 ms) 2024-09-15T12:19:11.898 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCreateLsRenameSnapPP 2024-09-15T12:19:11.898 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:19:12.904 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 1 2024-09-15T12:19:12.904 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 1 2024-09-15T12:19:12.904 INFO:tasks.workunit.client.0.smithi092.stdout:snap: snap1 2024-09-15T12:19:12.904 INFO:tasks.workunit.client.0.smithi092.stdout:found snap1 with size 2097152 2024-09-15T12:19:13.908 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 2 2024-09-15T12:19:13.908 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 2 2024-09-15T12:19:13.908 INFO:tasks.workunit.client.0.smithi092.stdout:snap: snap1 2024-09-15T12:19:13.908 INFO:tasks.workunit.client.0.smithi092.stdout:snap: snap2 2024-09-15T12:19:13.909 INFO:tasks.workunit.client.0.smithi092.stdout:found snap1 with size 2097152 2024-09-15T12:19:13.909 INFO:tasks.workunit.client.0.smithi092.stdout:found snap2 with size 4194304 2024-09-15T12:19:13.945 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 2 2024-09-15T12:19:13.945 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 2 2024-09-15T12:19:13.945 INFO:tasks.workunit.client.0.smithi092.stdout:snap: snap1-rename 2024-09-15T12:19:13.945 INFO:tasks.workunit.client.0.smithi092.stdout:snap: snap2 2024-09-15T12:19:13.945 INFO:tasks.workunit.client.0.smithi092.stdout:found snap1-rename with size 2097152 2024-09-15T12:19:13.945 INFO:tasks.workunit.client.0.smithi092.stdout:found snap2 with size 4194304 2024-09-15T12:19:14.939 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 1 2024-09-15T12:19:14.939 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 1 2024-09-15T12:19:14.940 INFO:tasks.workunit.client.0.smithi092.stdout:snap: snap2-rename 2024-09-15T12:19:14.940 INFO:tasks.workunit.client.0.smithi092.stdout:found snap2-rename with size 4194304 2024-09-15T12:19:15.910 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 0 2024-09-15T12:19:15.910 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 0 2024-09-15T12:19:15.922 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCreateLsRenameSnapPP (4024 ms) 2024-09-15T12:19:15.922 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ConcurrentCreatesUnvalidatedPool 2024-09-15T12:19:17.784 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:19:17.784 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:19:17.784 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:19:17.784 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:19:20.411 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.ConcurrentCreatesUnvalidatedPool (4489 ms) 2024-09-15T12:19:20.412 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.RemoveFullTry 2024-09-15T12:19:25.009 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:19:56.096 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.RemoveFullTry (35683 ms) 2024-09-15T12:19:56.096 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.RemoveFullTryDataPool 2024-09-15T12:19:56.096 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2227: Skipped 2024-09-15T12:19:56.096 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:19:56.096 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryDataPool (0 ms) 2024-09-15T12:19:56.096 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespace 2024-09-15T12:19:56.096 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2247: Skipped 2024-09-15T12:19:56.096 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:19:56.097 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespace (0 ms) 2024-09-15T12:19:56.097 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespaceDataPool 2024-09-15T12:19:56.097 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2269: Skipped 2024-09-15T12:19:56.097 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:19:56.097 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespaceDataPool (0 ms) 2024-09-15T12:19:56.097 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestIO 2024-09-15T12:19:56.097 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:20:19.869 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:20:19.870 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:20:19.870 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:20:19.870 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:20:19.870 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:20:19.870 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.870 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:20:19.870 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.870 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.870 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:20:19.871 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.871 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:20:19.871 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.871 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.871 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:20:19.871 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.871 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:20:19.871 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.871 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.871 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:20:19.871 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.871 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:20:19.871 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.872 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.872 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:20:19.872 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.872 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:20:19.872 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.872 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.872 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:20:19.872 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:20:19.872 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:20:19.872 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:20:19.872 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:20:19.872 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:20:19.872 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:20:19.872 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:20:19.873 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:20:19.873 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:20:19.873 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:20:19.873 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.873 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:20:19.873 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.873 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.873 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:20:19.873 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.873 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:20:19.873 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.873 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.873 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:20:19.873 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.873 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:20:19.874 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.874 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.874 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:20:19.874 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.874 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:20:19.874 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.874 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.874 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:20:19.874 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.874 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:20:19.874 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.874 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.874 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:20:19.874 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:20:19.875 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:20:19.875 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:20:19.875 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:20:19.875 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:20:19.875 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.875 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:20:19.875 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:20:19.875 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:20:19.875 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.875 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:20:19.875 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:20:19.875 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:20:19.875 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.875 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:20:19.876 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:20:19.876 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:20:19.876 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.876 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:20:19.876 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:20:19.876 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:20:19.876 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.876 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:20:19.876 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:20:19.876 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:20:19.876 INFO:tasks.workunit.client.0.smithi092.stdout:discard: 512~512 = 512 2024-09-15T12:20:19.876 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.876 INFO:tasks.workunit.client.0.smithi092.stdout:aio discard: 1536~512 = 0 2024-09-15T12:20:19.876 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:20:19.877 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:20:19.877 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:20:19.877 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:20:19.877 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:20:19.877 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 0 2024-09-15T12:20:19.877 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.877 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.877 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 0 2024-09-15T12:20:19.877 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.877 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.877 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 16384 2024-09-15T12:20:19.877 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.877 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.877 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 16384 2024-09-15T12:20:19.877 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.878 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.878 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:19.878 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:19.878 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 49152 2024-09-15T12:20:19.878 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.878 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.878 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 49152 2024-09-15T12:20:19.878 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.878 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.878 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 65536 2024-09-15T12:20:19.878 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.878 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.878 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 65536 2024-09-15T12:20:19.878 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.878 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.879 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:19.879 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:19.879 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 98304 2024-09-15T12:20:19.879 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.879 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.879 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 98304 2024-09-15T12:20:19.879 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.879 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.879 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 114688 2024-09-15T12:20:19.879 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.879 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.879 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 114688 2024-09-15T12:20:19.879 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.879 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.879 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:19.880 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:19.880 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 147456 2024-09-15T12:20:19.880 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.880 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.880 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 147456 2024-09-15T12:20:19.880 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.880 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.880 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 163840 2024-09-15T12:20:19.880 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.880 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.880 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 163840 2024-09-15T12:20:19.880 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.880 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.880 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:19.880 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:19.881 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 196608 2024-09-15T12:20:19.881 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.881 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.881 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 196608 2024-09-15T12:20:19.881 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.881 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.881 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 212992 2024-09-15T12:20:19.881 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.881 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.881 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 212992 2024-09-15T12:20:19.881 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.881 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.882 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:19.882 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:19.882 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.882 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:19.882 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.882 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.882 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:19.882 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.882 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.882 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.882 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:19.882 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.882 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.882 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:19.883 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.883 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.883 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.883 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:19.883 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.883 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.883 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:19.883 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.883 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.883 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.883 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:19.883 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.883 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.883 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:19.884 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.884 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.884 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.884 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:19.884 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:19.884 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.884 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:19.884 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:19.884 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.884 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:19.884 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.884 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.884 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:19.885 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.885 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.885 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:19.885 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:19.885 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:19.885 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:19.885 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:19.885 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:19.885 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:19.885 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.346 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.346 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:40.346 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:40.347 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:40.347 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:40.347 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:40.347 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.347 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.347 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:40.347 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:40.347 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:40.347 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:40.347 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:40.347 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.347 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.347 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:40.347 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.348 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.348 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:40.348 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.348 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.348 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:40.348 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:40.348 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:40.348 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:40.348 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:40.348 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.348 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.348 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:40.348 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:40.348 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:40.348 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:40.349 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:40.349 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.349 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.349 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:40.349 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:40.349 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:40.349 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:40.349 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:40.349 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.349 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.349 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:40.349 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:40.349 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:40.349 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:40.350 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:40.350 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.350 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.350 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:40.350 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.350 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.350 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:40.350 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.350 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.350 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:40.350 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:40.350 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:40.350 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:40.351 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:40.351 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.351 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.351 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:40.351 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:40.351 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:40.351 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:40.351 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:40.351 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.351 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.351 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:40.351 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:40.351 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:40.351 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:40.352 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:40.352 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.352 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.352 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:40.352 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:40.352 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:40.352 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:40.352 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:40.352 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.352 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.352 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:40.352 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.352 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.353 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:40.353 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.353 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.353 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:40.353 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:40.353 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:40.353 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:40.353 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:40.353 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.353 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.353 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:40.353 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:40.353 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:40.353 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:40.353 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.354 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.355 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:40.355 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:20:40.355 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:20:40.355 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:20:40.355 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:20:40.355 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:20:40.355 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:20:40.355 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:20:40.355 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestIO (44251 ms) 2024-09-15T12:20:40.355 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS1 2024-09-15T12:20:40.355 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:21:12.227 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:21:12.227 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:21:12.227 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:21:12.227 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:21:12.227 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:21:12.228 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.228 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:21:12.228 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.228 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.228 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:21:12.228 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.228 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:21:12.228 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.228 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.228 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:21:12.228 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.229 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:21:12.229 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.229 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.229 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:21:12.229 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.229 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:21:12.229 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.229 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.229 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:21:12.229 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.229 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:21:12.229 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.230 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.230 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:21:12.230 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:21:12.230 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:21:12.230 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:21:12.230 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:21:12.230 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:21:12.230 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:21:12.230 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:21:12.230 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:21:12.230 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:21:12.230 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:21:12.230 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.231 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:21:12.231 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.231 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.231 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:21:12.231 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.231 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:21:12.231 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.231 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.231 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:21:12.231 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.231 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:21:12.231 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.231 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.231 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:21:12.231 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.232 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:21:12.232 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.232 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.232 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:21:12.232 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.232 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:21:12.233 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.233 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.233 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:21:12.233 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:21:12.233 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:21:12.233 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:21:12.233 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:21:12.233 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:21:12.233 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.233 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:21:12.233 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:21:12.233 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:21:12.233 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.233 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:21:12.234 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:21:12.234 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:21:12.234 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.234 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:21:12.234 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:21:12.234 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:21:12.234 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.234 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:21:12.234 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:21:12.234 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:21:12.234 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.234 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:21:12.234 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:21:12.234 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:21:12.234 INFO:tasks.workunit.client.0.smithi092.stdout:discard: 512~512 = 512 2024-09-15T12:21:12.235 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.235 INFO:tasks.workunit.client.0.smithi092.stdout:aio discard: 1536~512 = 0 2024-09-15T12:21:12.235 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:21:12.235 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:21:12.235 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:21:12.235 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:21:12.235 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:21:12.235 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 0 2024-09-15T12:21:12.235 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.235 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.235 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 0 2024-09-15T12:21:12.235 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.235 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.235 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 16384 2024-09-15T12:21:12.235 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.236 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.236 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 16384 2024-09-15T12:21:12.236 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.236 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.236 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:12.236 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:12.236 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 49152 2024-09-15T12:21:12.236 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.236 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.236 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 49152 2024-09-15T12:21:12.236 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.236 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.236 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 65536 2024-09-15T12:21:12.236 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.236 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.237 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 65536 2024-09-15T12:21:12.237 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.237 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.237 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:12.237 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:12.237 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 98304 2024-09-15T12:21:12.237 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.237 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.237 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 98304 2024-09-15T12:21:12.237 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.237 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.237 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 114688 2024-09-15T12:21:12.237 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.237 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.238 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 114688 2024-09-15T12:21:12.238 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.238 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.238 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:12.238 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:12.238 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 147456 2024-09-15T12:21:12.238 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.238 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.238 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 147456 2024-09-15T12:21:12.238 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.238 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.239 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 163840 2024-09-15T12:21:12.239 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.239 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.239 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 163840 2024-09-15T12:21:12.239 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.239 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.239 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:12.239 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:12.239 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 196608 2024-09-15T12:21:12.239 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.239 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.239 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 196608 2024-09-15T12:21:12.240 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.240 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.240 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 212992 2024-09-15T12:21:12.240 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.240 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.240 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 212992 2024-09-15T12:21:12.240 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.240 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.240 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:12.240 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:12.240 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.240 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:12.240 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.241 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.241 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:12.241 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.241 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.241 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.241 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:12.241 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.241 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.241 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:12.241 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.241 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.241 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.241 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:12.241 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.242 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:12.243 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:12.243 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.243 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:12.243 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.243 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.243 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:12.243 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.243 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.243 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:12.243 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:12.243 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:12.244 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:12.244 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:12.244 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:12.244 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:12.244 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.329 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.329 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:41.329 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:41.329 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:41.330 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:41.330 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:41.330 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.330 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.330 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:41.330 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:41.330 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:41.330 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:41.330 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:41.330 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.330 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.330 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:41.331 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.331 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.331 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:41.331 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.331 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.331 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:41.331 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:41.331 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:41.331 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:41.331 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:41.331 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.331 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.331 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:41.332 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:41.332 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:41.332 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:41.332 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:41.332 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.332 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.332 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:41.332 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:41.332 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:41.332 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:41.332 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:41.332 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.332 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.333 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:41.333 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:41.333 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:41.333 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:41.333 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:41.333 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.333 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.333 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:41.333 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.333 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.333 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:41.333 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.333 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.333 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:41.334 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:41.334 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:41.334 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:41.334 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:41.334 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.334 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.334 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:41.334 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:41.334 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:41.334 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:41.334 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:41.334 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.334 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.334 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:41.335 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:41.335 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:41.335 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:41.335 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:41.335 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.335 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.335 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:41.335 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:41.335 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:41.335 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:41.335 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:41.335 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.335 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.335 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:41.336 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.336 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.336 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:41.336 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.336 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.336 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:41.336 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:41.336 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:41.336 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:41.336 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:41.336 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.336 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.336 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:41.337 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:41.337 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:41.337 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:41.337 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:41.337 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.337 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.337 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:41.337 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:41.337 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:41.337 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:41.337 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:41.337 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.337 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.338 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:21:41.338 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:21:41.338 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:21:41.338 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:21:41.338 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:21:41.338 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.338 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.338 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:41.338 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:21:41.338 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:21:41.338 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:21:41.338 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:21:41.338 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:21:41.339 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:21:41.339 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:21:41.339 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 4 2024-09-15T12:21:41.339 INFO:tasks.workunit.client.0.smithi092.stdout:read: 4 2024-09-15T12:21:41.339 INFO:tasks.workunit.client.0.smithi092.stdout:read: 4 2024-09-15T12:21:41.339 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS1 (60982 ms) 2024-09-15T12:21:41.339 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS2 2024-09-15T12:21:41.339 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:22:14.655 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:22:14.655 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:22:14.655 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:22:14.655 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:22:14.656 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:22:14.656 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.656 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:22:14.656 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.656 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.656 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:22:14.656 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.656 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:22:14.656 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.656 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.656 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:22:14.656 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.656 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:22:14.657 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.657 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.657 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:22:14.657 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.657 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:22:14.657 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.657 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.657 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:22:14.657 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.657 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:22:14.657 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.657 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.657 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:22:14.658 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:22:14.658 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:22:14.658 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:22:14.658 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:22:14.658 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:22:14.658 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:22:14.658 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:22:14.658 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:22:14.658 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:22:14.658 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:22:14.658 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.658 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:22:14.659 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.659 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.659 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:22:14.659 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.659 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:22:14.659 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.659 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.659 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:22:14.659 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.659 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:22:14.660 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.660 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.660 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:22:14.660 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.660 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:22:14.660 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.660 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.660 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:22:14.660 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.660 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:22:14.660 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.660 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.660 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:22:14.660 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:22:14.660 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:22:14.661 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:22:14.661 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:22:14.661 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:22:14.661 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.661 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:22:14.661 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:22:14.661 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:22:14.661 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.661 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:22:14.661 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:22:14.661 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:22:14.661 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.661 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:22:14.662 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:22:14.662 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:22:14.662 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.662 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:22:14.662 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:22:14.662 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:22:14.662 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.662 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:22:14.662 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:22:14.662 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:22:14.662 INFO:tasks.workunit.client.0.smithi092.stdout:discard: 512~512 = 512 2024-09-15T12:22:14.662 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.662 INFO:tasks.workunit.client.0.smithi092.stdout:aio discard: 1536~512 = 0 2024-09-15T12:22:14.662 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 0 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 0 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 16384 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 16384 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.663 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.664 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:14.664 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:14.664 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 49152 2024-09-15T12:22:14.664 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.664 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.664 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 49152 2024-09-15T12:22:14.664 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.664 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.664 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 65536 2024-09-15T12:22:14.664 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.664 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.664 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 65536 2024-09-15T12:22:14.664 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.665 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.665 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:14.665 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:14.665 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 98304 2024-09-15T12:22:14.665 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.665 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.665 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 98304 2024-09-15T12:22:14.665 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.665 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.665 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 114688 2024-09-15T12:22:14.665 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.665 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.665 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 114688 2024-09-15T12:22:14.665 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.665 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.666 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:14.666 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:14.666 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 147456 2024-09-15T12:22:14.666 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.666 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.666 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 147456 2024-09-15T12:22:14.666 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.666 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.666 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 163840 2024-09-15T12:22:14.666 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.666 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.666 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 163840 2024-09-15T12:22:14.666 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.666 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.666 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 196608 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 196608 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 212992 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 212992 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:14.667 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.668 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:14.668 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.668 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.668 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:14.668 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.668 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.668 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.668 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:14.668 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.668 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.668 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:14.668 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.668 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.668 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.669 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:14.669 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.669 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.669 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:14.669 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.669 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.669 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.669 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:14.669 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.669 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.669 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:14.669 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.669 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.669 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.670 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:14.670 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:14.670 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.670 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:14.670 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:14.670 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.670 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:14.670 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.670 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.670 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:14.670 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.670 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.670 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:14.671 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:14.671 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:14.671 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:14.671 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:14.671 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:14.671 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:14.671 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.017 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.017 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:41.018 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:41.018 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:41.018 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:41.018 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:41.018 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.018 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.018 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:41.018 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:41.018 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:41.018 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:41.018 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:41.018 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.018 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.019 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:41.019 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.019 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.019 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:41.019 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.019 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.019 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:41.019 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:41.019 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:41.019 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:41.019 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:41.019 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.019 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.019 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:41.020 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:41.020 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:41.020 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:41.020 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:41.020 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.020 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.020 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:41.020 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:41.020 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:41.020 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:41.020 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:41.020 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.020 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.020 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:41.021 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:41.021 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:41.021 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:41.021 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:41.021 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.021 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.021 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:41.021 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.021 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.021 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:41.021 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.021 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.021 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:41.022 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:41.022 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:41.022 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:41.022 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:41.022 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.022 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.022 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:41.022 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:41.022 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:41.022 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:41.022 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:41.023 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.023 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.023 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:41.023 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:41.023 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:41.023 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:41.023 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:41.023 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.023 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.023 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:41.024 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:41.024 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:41.024 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:41.024 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:41.024 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.024 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.024 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:41.024 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.024 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.024 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:41.024 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.024 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.024 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:41.024 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:41.025 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:41.025 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:41.025 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:41.025 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.025 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.026 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:41.026 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:41.026 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:41.026 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:41.026 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:41.026 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.026 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.026 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:41.026 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:41.026 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:41.026 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:41.027 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:41.027 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.027 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.027 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:22:41.027 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:22:41.027 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:22:41.027 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:22:41.027 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:22:41.027 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.027 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.027 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:41.027 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:22:41.027 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:22:41.028 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:22:41.028 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:22:41.028 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:22:41.028 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:22:41.028 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:22:41.028 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 4 2024-09-15T12:22:41.028 INFO:tasks.workunit.client.0.smithi092.stdout:read: 4 2024-09-15T12:22:41.028 INFO:tasks.workunit.client.0.smithi092.stdout:read: 4 2024-09-15T12:22:41.028 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS2 (59688 ms) 2024-09-15T12:22:41.028 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCloneEncryption 2024-09-15T12:22:41.028 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2471: Skipped 2024-09-15T12:22:41.028 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:22:41.028 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestCloneEncryption (1 ms) 2024-09-15T12:22:41.029 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.LUKS1UnderLUKS2WithoutResize 2024-09-15T12:22:41.029 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2659: Skipped 2024-09-15T12:22:41.029 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:22:41.029 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.LUKS1UnderLUKS2WithoutResize (0 ms) 2024-09-15T12:22:41.029 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.LUKS2UnderLUKS1WithoutResize 2024-09-15T12:22:41.029 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2735: Skipped 2024-09-15T12:22:41.029 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:22:41.029 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.LUKS2UnderLUKS1WithoutResize (0 ms) 2024-09-15T12:22:41.029 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.EncryptionFormatNoData 2024-09-15T12:22:41.029 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:22:45.532 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.EncryptionFormatNoData (4515 ms) 2024-09-15T12:22:45.532 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadSize 2024-09-15T12:22:45.532 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:22:51.525 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.EncryptionLoadBadSize (5993 ms) 2024-09-15T12:22:51.525 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-15T12:22:51.526 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2905: Skipped 2024-09-15T12:22:51.526 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:22:51.526 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern (0 ms) 2024-09-15T12:22:51.526 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.EncryptionLoadFormatMismatch 2024-09-15T12:22:51.526 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2985: Skipped 2024-09-15T12:22:51.526 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:22:51.526 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadFormatMismatch (0 ms) 2024-09-15T12:22:51.526 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.EncryptedResize 2024-09-15T12:22:51.526 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:03.917 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.EncryptedResize (12392 ms) 2024-09-15T12:23:03.917 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.EncryptedFlattenSmallData 2024-09-15T12:23:03.918 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3202: Skipped 2024-09-15T12:23:03.918 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:23:03.918 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.EncryptedFlattenSmallData (0 ms) 2024-09-15T12:23:03.918 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestIOWithIOHint 2024-09-15T12:23:03.918 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:28.745 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:28.745 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:28.746 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:28.746 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:28.746 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:28.746 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.746 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:23:28.746 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.746 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.746 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:23:28.746 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.746 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:23:28.746 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.746 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.746 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:23:28.746 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.747 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:23:28.747 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.747 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.747 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:23:28.747 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.747 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:23:28.747 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.747 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.747 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:23:28.747 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.747 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:23:28.747 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.747 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.747 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:23:28.747 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:23:28.748 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:23:28.748 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:23:28.748 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:23:28.748 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:23:28.748 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:23:28.748 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:23:28.748 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:23:28.748 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:23:28.748 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:23:28.748 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.748 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:23:28.748 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.748 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.748 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:23:28.749 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.749 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:23:28.749 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.749 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.749 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:23:28.749 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.749 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:23:28.749 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.749 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.749 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:23:28.749 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.749 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:23:28.749 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.749 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.749 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:23:28.750 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.750 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:23:28.750 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.750 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.750 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:23:28.750 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:28.750 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:28.750 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:28.750 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:28.750 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:28.750 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.750 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:23:28.750 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:28.750 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:23:28.750 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.751 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:23:28.751 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:28.751 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:23:28.751 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.751 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:23:28.751 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:28.751 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:23:28.751 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.751 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:23:28.751 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:28.751 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:23:28.751 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.751 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:23:28.751 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:28.751 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:23:28.752 INFO:tasks.workunit.client.0.smithi092.stdout:discard: 512~512 = 512 2024-09-15T12:23:28.752 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.752 INFO:tasks.workunit.client.0.smithi092.stdout:aio discard: 1536~512 = 0 2024-09-15T12:23:28.752 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:28.752 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:28.752 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:28.752 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:28.752 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:28.752 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 0 2024-09-15T12:23:28.752 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.752 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.752 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 0 2024-09-15T12:23:28.752 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.752 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.753 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 16384 2024-09-15T12:23:28.753 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.753 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.753 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 16384 2024-09-15T12:23:28.753 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.753 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.753 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:28.753 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:28.753 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 49152 2024-09-15T12:23:28.753 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.753 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.753 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 49152 2024-09-15T12:23:28.753 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.753 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.754 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 65536 2024-09-15T12:23:28.754 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.754 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.754 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 65536 2024-09-15T12:23:28.754 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.754 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.754 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:28.754 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:28.754 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 98304 2024-09-15T12:23:28.754 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.754 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.754 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 98304 2024-09-15T12:23:28.754 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.754 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.754 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 114688 2024-09-15T12:23:28.755 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.755 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.755 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 114688 2024-09-15T12:23:28.755 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.755 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.755 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:28.755 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:28.755 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 147456 2024-09-15T12:23:28.755 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.755 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.755 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 147456 2024-09-15T12:23:28.755 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.755 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.755 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 163840 2024-09-15T12:23:28.755 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.756 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.756 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 163840 2024-09-15T12:23:28.756 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.756 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.756 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:28.756 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:28.756 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 196608 2024-09-15T12:23:28.756 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.756 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.756 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 196608 2024-09-15T12:23:28.756 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.756 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.756 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 212992 2024-09-15T12:23:28.756 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.757 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.757 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 212992 2024-09-15T12:23:28.757 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.757 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.757 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:28.757 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:28.757 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.757 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:28.757 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.757 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.757 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:28.757 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.757 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.757 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.757 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:28.758 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.758 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.758 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:28.758 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.758 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.758 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.758 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:28.758 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.758 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.758 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:28.758 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.758 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.758 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.758 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:28.758 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:28.759 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.760 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.760 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:28.760 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:28.760 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:28.760 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:28.760 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:28.760 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:28.760 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:28.760 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.322 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.322 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:50.322 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:50.322 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:50.322 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:50.322 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:50.322 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.322 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.322 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:50.322 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:50.323 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:50.323 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:50.323 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:50.323 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.323 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.323 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:50.323 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.323 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.323 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:50.323 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.323 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.323 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:50.323 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:50.323 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:50.323 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:50.324 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:50.324 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.324 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.324 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:50.324 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:50.324 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:50.324 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:50.324 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:50.324 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.324 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.324 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:50.324 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:50.325 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:50.325 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:50.325 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:50.325 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.325 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.325 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:50.325 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:50.325 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:50.325 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:50.325 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:50.325 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.325 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.325 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:50.325 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.326 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.326 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:50.326 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.326 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.326 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:50.326 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:50.326 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:50.326 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:50.326 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:50.326 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.326 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.326 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:50.326 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:50.326 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:50.328 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:50.328 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:50.328 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.328 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.328 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:50.328 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.328 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.328 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:50.328 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.328 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.328 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:50.328 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:50.328 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:50.328 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:50.329 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:50.329 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.329 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.329 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:50.329 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:50.329 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:50.329 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:50.329 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:50.329 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.329 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.329 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:50.329 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:50.329 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:50.330 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:50.330 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:50.330 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.330 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.330 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:50.330 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:50.330 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:23:50.330 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:23:50.330 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:23:50.330 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.330 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.330 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:50.330 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:50.330 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:23:50.331 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:23:50.331 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:50.331 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:50.331 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:50.331 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestIOWithIOHint (46404 ms) 2024-09-15T12:23:50.331 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestDataPoolIO 2024-09-15T12:23:50.331 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3947: Skipped 2024-09-15T12:23:50.331 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:23:50.331 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestDataPoolIO (0 ms) 2024-09-15T12:23:50.331 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatch 2024-09-15T12:23:50.331 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:50.445 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatch (124 ms) 2024-09-15T12:23:50.445 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatch 2024-09-15T12:23:50.445 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:50.575 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatch (130 ms) 2024-09-15T12:23:50.575 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccess 2024-09-15T12:23:50.575 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:50.703 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccess (128 ms) 2024-09-15T12:23:50.703 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccess 2024-09-15T12:23:50.703 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:50.834 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccess (131 ms) 2024-09-15T12:23:50.834 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned 2024-09-15T12:23:50.834 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:51.054 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned (220 ms) 2024-09-15T12:23:51.054 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned 2024-09-15T12:23:51.054 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:51.250 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned (196 ms) 2024-09-15T12:23:51.250 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLarge 2024-09-15T12:23:51.250 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:51.449 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLarge (199 ms) 2024-09-15T12:23:51.449 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLarge 2024-09-15T12:23:51.449 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:51.658 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLarge (209 ms) 2024-09-15T12:23:51.658 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess 2024-09-15T12:23:51.659 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:53.919 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess (2260 ms) 2024-09-15T12:23:53.920 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess 2024-09-15T12:23:53.920 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:56.279 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess (2360 ms) 2024-09-15T12:23:56.279 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers 2024-09-15T12:23:56.279 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:56.395 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers (116 ms) 2024-09-15T12:23:56.395 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVMismatch 2024-09-15T12:23:56.395 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:56.522 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVMismatch (127 ms) 2024-09-15T12:23:56.522 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVSuccess 2024-09-15T12:23:56.522 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:56.653 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVSuccess (131 ms) 2024-09-15T12:23:56.653 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestScatterGatherIO 2024-09-15T12:23:56.653 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:56.780 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestScatterGatherIO (127 ms) 2024-09-15T12:23:56.780 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestEmptyDiscard 2024-09-15T12:23:56.780 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:56.897 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:56.897 INFO:tasks.workunit.client.0.smithi092.stdout:aio discard: 0~1048576 = 0 2024-09-15T12:23:56.897 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:56.897 INFO:tasks.workunit.client.0.smithi092.stdout:aio discard: 0~4194304 = 0 2024-09-15T12:23:56.897 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:56.898 INFO:tasks.workunit.client.0.smithi092.stdout:aio discard: 3145728~1048576 = 0 2024-09-15T12:23:56.898 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestEmptyDiscard (117 ms) 2024-09-15T12:23:56.898 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestFUA 2024-09-15T12:23:56.898 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:57.375 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:57.375 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:57.375 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:57.375 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:57.375 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:57.375 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:57.375 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:57.375 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:57.375 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:57.375 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:57.376 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.376 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:23:57.376 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:57.376 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:57.376 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:23:57.376 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.376 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:23:57.376 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:57.376 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:57.376 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:23:57.376 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.376 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:23:57.376 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:57.376 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:57.376 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:23:57.377 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.377 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:23:57.377 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:57.377 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:57.377 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:23:57.377 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.377 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:23:57.377 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:57.377 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:57.377 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:23:57.377 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.377 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:23:57.377 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:23:57.378 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:57.379 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:23:57.379 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestFUA (478 ms) 2024-09-15T12:23:57.379 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestIOPP 2024-09-15T12:23:57.379 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:23:57.456 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:57.456 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:57.456 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:57.457 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:57.457 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:23:57.457 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.457 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:23:57.457 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:57.457 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:57.457 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:23:57.457 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.457 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:23:57.457 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:57.457 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:57.457 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:23:57.457 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.458 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:23:57.458 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:57.458 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:57.458 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:23:57.458 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.458 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:23:57.458 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:57.458 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:57.458 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:23:57.458 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.458 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:23:57.458 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:57.624 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:57.624 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:23:57.624 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:23:57.624 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:23:57.624 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:23:57.624 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:23:57.624 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:23:57.624 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:23:57.625 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:23:57.625 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:23:57.625 INFO:tasks.workunit.client.0.smithi092.stdout:start compare and write 2024-09-15T12:23:57.625 INFO:tasks.workunit.client.0.smithi092.stdout:compare and wrote: 512 2024-09-15T12:23:57.625 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.625 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:23:57.625 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:57.637 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:57.637 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:23:57.637 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.637 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:23:57.637 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:57.650 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:57.650 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:23:57.650 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.650 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:23:57.650 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:57.665 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:57.665 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:23:57.665 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.666 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:23:57.666 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:57.679 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:57.679 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:23:57.679 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.679 INFO:tasks.workunit.client.0.smithi092.stdout:started aio compare and write 2024-09-15T12:23:57.679 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:23:57.714 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:23:57.714 INFO:tasks.workunit.client.0.smithi092.stdout:finished aio compare and write 2024-09-15T12:23:57.714 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:57.714 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:57.714 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:57.714 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:57.714 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:23:57.714 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.715 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:23:57.715 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:57.719 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:23:57.719 INFO:tasks.workunit.client.0.smithi092.stdout:finished read 2024-09-15T12:23:57.719 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.719 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:23:57.719 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:57.724 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:23:57.724 INFO:tasks.workunit.client.0.smithi092.stdout:finished read 2024-09-15T12:23:57.724 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.724 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:23:57.724 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:57.729 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:23:57.729 INFO:tasks.workunit.client.0.smithi092.stdout:finished read 2024-09-15T12:23:57.729 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.729 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:23:57.729 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:57.733 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:23:57.733 INFO:tasks.workunit.client.0.smithi092.stdout:finished read 2024-09-15T12:23:57.734 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:23:57.734 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:23:57.734 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:23:57.734 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:23:57.734 INFO:tasks.workunit.client.0.smithi092.stdout:finished read 2024-09-15T12:23:57.734 INFO:tasks.workunit.client.0.smithi092.stdout:discard: 512~512 2024-09-15T12:23:57.734 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:17.738 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:24:17.738 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:24:17.738 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:24:17.738 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:24:17.738 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:24:17.738 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 0 2024-09-15T12:24:17.738 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.739 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.739 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 0 2024-09-15T12:24:17.739 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.739 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.739 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 16384 2024-09-15T12:24:17.739 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.739 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.739 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 16384 2024-09-15T12:24:17.739 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.739 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.739 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:17.739 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:17.739 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 49152 2024-09-15T12:24:17.739 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.739 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.740 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 49152 2024-09-15T12:24:17.740 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.740 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.740 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 65536 2024-09-15T12:24:17.740 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.740 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.740 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 65536 2024-09-15T12:24:17.740 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.740 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.740 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:17.740 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:17.740 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 98304 2024-09-15T12:24:17.740 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.741 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.741 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 98304 2024-09-15T12:24:17.741 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.741 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.741 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 114688 2024-09-15T12:24:17.741 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.741 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.741 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 114688 2024-09-15T12:24:17.741 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.741 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.741 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:17.741 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:17.741 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 147456 2024-09-15T12:24:17.741 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.741 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.742 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 147456 2024-09-15T12:24:17.742 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.742 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.742 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 163840 2024-09-15T12:24:17.742 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.742 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.742 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 163840 2024-09-15T12:24:17.742 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.742 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.742 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:17.742 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:17.742 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 196608 2024-09-15T12:24:17.742 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.742 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.743 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 196608 2024-09-15T12:24:17.743 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.743 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.743 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 212992 2024-09-15T12:24:17.743 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.743 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.743 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 212992 2024-09-15T12:24:17.743 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.743 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.743 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:17.743 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:17.743 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:17.743 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:17.743 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:17.744 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:17.744 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:17.744 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.744 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.744 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:17.744 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:17.744 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:17.744 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:17.744 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:17.744 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.744 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.744 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:17.744 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:17.744 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:17.925 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:17.925 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:17.925 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:17.926 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:17.926 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:17.926 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:17.926 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:18.082 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:18.082 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:18.082 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:18.082 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:18.082 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:18.082 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:18.083 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:18.083 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:18.083 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:18.083 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:18.083 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:18.083 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:18.083 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:18.623 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:18.623 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:18.623 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:18.623 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:18.623 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:18.624 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:18.624 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:19.049 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:19.049 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:19.049 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:19.050 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:19.050 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:19.050 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:19.050 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:19.672 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:19.672 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:19.672 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:19.672 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:19.672 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:19.672 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:19.672 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:20.273 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:20.274 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:20.274 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:20.274 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:20.274 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:20.274 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:20.274 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:20.274 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:20.274 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:20.274 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:20.274 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:20.274 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:20.275 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:21.218 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:21.218 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:21.218 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:21.218 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:21.218 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:21.218 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:21.218 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:22.077 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:22.078 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:22.078 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:22.078 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:22.078 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:22.078 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:22.078 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:23.176 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:23.177 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:23.177 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:23.177 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:23.177 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:23.177 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:23.177 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:24.146 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:24.146 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:24.146 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:24.146 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:24.146 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:24.146 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:24.146 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:24.147 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:24.147 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:24.147 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:24.147 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:24.147 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:24.147 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:25.689 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:25.690 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:25.690 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:25.690 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:25.690 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:25.690 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:25.690 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:27.031 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:27.031 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:27.031 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:27.031 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:27.032 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:27.032 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:27.032 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:28.611 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:28.611 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:28.611 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:28.611 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:28.611 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:28.611 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:28.611 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:30.013 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:30.013 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:30.013 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:30.013 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:30.013 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:30.013 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:30.013 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:30.014 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:30.014 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:30.014 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:30.014 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:30.014 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:30.014 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:32.038 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:32.039 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:32.039 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:32.039 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:32.039 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:32.039 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:32.039 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:33.777 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:33.777 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:33.777 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:33.777 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:33.777 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:33.777 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:33.777 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:35.859 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:35.859 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:35.859 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:35.859 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:35.859 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:35.859 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:35.859 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:37.734 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:37.734 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:24:37.734 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:24:37.734 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:24:37.734 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:37.734 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:37.734 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:37.734 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:37.735 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:24:37.735 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:24:37.735 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestIOPP (40359 ms) 2024-09-15T12:24:37.735 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP 2024-09-15T12:24:37.735 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:37.841 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP (107 ms) 2024-09-15T12:24:37.841 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP 2024-09-15T12:24:37.841 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:37.943 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP (102 ms) 2024-09-15T12:24:37.943 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP 2024-09-15T12:24:37.943 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:38.054 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP (111 ms) 2024-09-15T12:24:38.054 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP 2024-09-15T12:24:38.055 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:38.180 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP (127 ms) 2024-09-15T12:24:38.180 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchPP 2024-09-15T12:24:38.180 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:38.329 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchPP (148 ms) 2024-09-15T12:24:38.329 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchPP 2024-09-15T12:24:38.329 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:38.428 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:38.455 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchPP (126 ms) 2024-09-15T12:24:38.455 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-15T12:24:38.455 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:38.576 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP (121 ms) 2024-09-15T12:24:38.577 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-15T12:24:38.577 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:38.674 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:38.710 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP (134 ms) 2024-09-15T12:24:38.710 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessPP 2024-09-15T12:24:38.710 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:38.836 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessPP (126 ms) 2024-09-15T12:24:38.837 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessPP 2024-09-15T12:24:38.837 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:38.937 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:38.961 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessPP (125 ms) 2024-09-15T12:24:38.961 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-15T12:24:38.961 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:39.109 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP (148 ms) 2024-09-15T12:24:39.109 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-15T12:24:39.109 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:39.231 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:39.261 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP (152 ms) 2024-09-15T12:24:39.261 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP 2024-09-15T12:24:39.261 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:39.470 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP (209 ms) 2024-09-15T12:24:39.470 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP 2024-09-15T12:24:39.470 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:39.627 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:39.674 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP (205 ms) 2024-09-15T12:24:39.675 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLargePP 2024-09-15T12:24:39.675 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:39.879 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLargePP (204 ms) 2024-09-15T12:24:39.879 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLargePP 2024-09-15T12:24:39.879 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:40.034 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:40.083 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLargePP (205 ms) 2024-09-15T12:24:40.083 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP 2024-09-15T12:24:40.084 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:42.358 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP (2274 ms) 2024-09-15T12:24:42.358 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP 2024-09-15T12:24:42.358 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:44.544 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:44.601 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP (2244 ms) 2024-09-15T12:24:44.602 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestIOPPWithIOHint 2024-09-15T12:24:44.602 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:24:44.753 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:24:44.753 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:24:44.753 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:24:44.753 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:24:44.753 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:24:44.753 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:44.753 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:24:44.753 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:44.765 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:44.765 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:24:44.765 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:44.765 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:24:44.765 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:44.777 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:44.777 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:24:44.777 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:44.777 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:24:44.778 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:44.789 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:44.789 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:24:44.789 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:44.789 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:24:44.789 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:44.804 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:44.804 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:24:44.804 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:44.804 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:24:44.804 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:24:44.813 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:24:44.814 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:24:44.814 INFO:tasks.workunit.client.0.smithi092.stdout:read: 512 2024-09-15T12:24:44.814 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:44.814 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:24:44.814 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:24:44.818 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:24:44.818 INFO:tasks.workunit.client.0.smithi092.stdout:finished read 2024-09-15T12:24:44.818 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:44.818 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:24:44.819 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:24:44.823 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:24:44.823 INFO:tasks.workunit.client.0.smithi092.stdout:finished read 2024-09-15T12:24:44.823 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:44.823 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:24:44.823 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:24:44.827 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:24:44.827 INFO:tasks.workunit.client.0.smithi092.stdout:finished read 2024-09-15T12:24:44.827 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:44.827 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:24:44.828 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:24:44.832 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:24:44.832 INFO:tasks.workunit.client.0.smithi092.stdout:finished read 2024-09-15T12:24:44.832 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:24:44.832 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:24:44.832 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:25:02.297 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:25:02.297 INFO:tasks.workunit.client.0.smithi092.stdout:finished read 2024-09-15T12:25:02.297 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 0 2024-09-15T12:25:02.297 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.297 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 0 2024-09-15T12:25:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 16384 2024-09-15T12:25:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 16384 2024-09-15T12:25:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 49152 2024-09-15T12:25:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.298 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 49152 2024-09-15T12:25:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 65536 2024-09-15T12:25:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 65536 2024-09-15T12:25:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 98304 2024-09-15T12:25:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.299 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 98304 2024-09-15T12:25:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 114688 2024-09-15T12:25:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 114688 2024-09-15T12:25:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 147456 2024-09-15T12:25:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.300 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 147456 2024-09-15T12:25:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 163840 2024-09-15T12:25:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 163840 2024-09-15T12:25:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 196608 2024-09-15T12:25:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.301 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 196608 2024-09-15T12:25:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 212992 2024-09-15T12:25:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 212992 2024-09-15T12:25:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:02.302 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:02.303 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:02.303 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.303 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.303 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:02.303 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:02.303 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:02.309 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:02.309 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:02.309 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.310 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.310 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:02.310 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:02.310 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:02.458 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:02.458 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:02.458 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.458 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.458 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:02.458 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:02.458 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:02.584 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:02.584 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:02.584 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:02.584 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:02.584 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:02.584 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:02.584 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:02.584 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:02.584 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:02.585 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:02.585 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:02.585 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:02.585 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:03.001 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:03.001 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:03.001 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:03.001 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:03.001 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:03.001 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:03.001 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:03.359 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:03.360 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:03.360 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:03.360 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:03.360 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:03.360 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:03.360 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:03.916 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:03.916 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:03.916 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:03.916 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:03.916 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:03.916 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:03.916 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:04.385 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:04.385 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:04.385 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:04.385 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:04.385 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:04.385 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:04.385 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:04.386 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:04.386 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:04.386 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:04.386 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:04.386 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:04.386 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:05.225 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:05.225 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:05.225 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:05.225 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:05.225 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:05.225 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:05.225 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:05.956 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:05.957 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:05.957 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:05.957 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:05.957 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:05.957 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:05.957 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:07.000 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:07.000 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:07.000 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:07.000 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:07.000 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:07.000 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:07.000 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:07.811 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:07.811 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:07.811 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:07.811 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:07.811 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:07.811 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:07.811 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:07.812 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:07.812 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:07.812 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:07.812 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:07.812 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:07.812 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:09.188 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:09.188 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:09.188 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:09.188 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:09.189 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:09.189 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:09.189 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:10.300 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:10.301 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:10.301 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:10.301 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:10.301 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:10.301 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:10.301 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:11.657 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:11.657 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:11.657 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:11.657 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:11.657 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:11.657 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:11.657 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:12.818 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:12.818 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:12.818 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:12.818 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:12.818 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:12.818 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:12.818 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:12.818 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:12.818 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:12.819 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:12.819 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:12.819 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:12.819 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:14.730 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:14.730 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:14.730 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:14.730 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:14.730 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:14.730 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:14.730 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:16.120 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:16.120 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:16.120 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:16.120 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:16.120 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:16.120 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:16.120 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:17.961 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:17.961 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:17.961 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:17.961 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:17.962 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:17.962 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:17.962 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:19.556 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:19.556 INFO:tasks.workunit.client.0.smithi092.stdout:finished writesame 2024-09-15T12:25:19.557 INFO:tasks.workunit.client.0.smithi092.stdout:to verify the data 2024-09-15T12:25:19.557 INFO:tasks.workunit.client.0.smithi092.stdout:verified 2024-09-15T12:25:19.557 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:19.557 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:19.557 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:19.557 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:19.557 INFO:tasks.workunit.client.0.smithi092.stdout:started writesame 2024-09-15T12:25:19.557 INFO:tasks.workunit.client.0.smithi092.stdout:expected fail, finished writesame 2024-09-15T12:25:19.557 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestIOPPWithIOHint (34954 ms) 2024-09-15T12:25:19.557 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestIOToSnapshot 2024-09-15T12:25:19.557 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:21.111 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 0 2024-09-15T12:25:21.111 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 0 2024-09-15T12:25:21.111 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 1 2024-09-15T12:25:21.111 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 1 2024-09-15T12:25:21.111 INFO:tasks.workunit.client.0.smithi092.stdout:snap: orig 2024-09-15T12:25:21.111 INFO:tasks.workunit.client.0.smithi092.stdout:found orig with size 2097152 2024-09-15T12:25:21.112 INFO:tasks.workunit.client.0.smithi092.stdout:read: 80 2024-09-15T12:25:21.112 INFO:tasks.workunit.client.0.smithi092.stdout:write test data! 2024-09-15T12:25:21.112 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 80 2024-09-15T12:25:21.112 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 2 2024-09-15T12:25:21.112 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 2 2024-09-15T12:25:21.112 INFO:tasks.workunit.client.0.smithi092.stdout:snap: orig 2024-09-15T12:25:21.112 INFO:tasks.workunit.client.0.smithi092.stdout:snap: written 2024-09-15T12:25:21.112 INFO:tasks.workunit.client.0.smithi092.stdout:found orig with size 2097152 2024-09-15T12:25:21.112 INFO:tasks.workunit.client.0.smithi092.stdout:found written with size 2097152 2024-09-15T12:25:21.112 INFO:tasks.workunit.client.0.smithi092.stdout:read: 80 2024-09-15T12:25:21.112 INFO:tasks.workunit.client.0.smithi092.stdout:read: 80 2024-09-15T12:25:21.112 INFO:tasks.workunit.client.0.smithi092.stdout:read: 80 2024-09-15T12:25:21.112 INFO:tasks.workunit.client.0.smithi092.stdout:write to snapshot returned -30 2024-09-15T12:25:21.112 INFO:tasks.workunit.client.0.smithi092.stdout:Read-only file system 2024-09-15T12:25:21.241 INFO:tasks.workunit.client.0.smithi092.stdout:read: 80 2024-09-15T12:25:21.241 INFO:tasks.workunit.client.0.smithi092.stdout:read: 80 2024-09-15T12:25:21.241 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 80 2024-09-15T12:25:21.241 INFO:tasks.workunit.client.0.smithi092.stdout:opening testimg@orig 2024-09-15T12:25:21.241 INFO:tasks.workunit.client.0.smithi092.stdout:read: 80 2024-09-15T12:25:21.241 INFO:tasks.workunit.client.0.smithi092.stdout:write to snapshot returned -30 2024-09-15T12:25:21.241 INFO:tasks.workunit.client.0.smithi092.stdout:Read-only file system 2024-09-15T12:25:23.109 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 2 2024-09-15T12:25:23.109 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 2 2024-09-15T12:25:23.109 INFO:tasks.workunit.client.0.smithi092.stdout:snap: orig 2024-09-15T12:25:23.109 INFO:tasks.workunit.client.0.smithi092.stdout:snap: written 2024-09-15T12:25:23.109 INFO:tasks.workunit.client.0.smithi092.stdout:found orig with size 2097152 2024-09-15T12:25:23.109 INFO:tasks.workunit.client.0.smithi092.stdout:found written with size 2097152 2024-09-15T12:25:23.109 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 1 2024-09-15T12:25:23.109 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 1 2024-09-15T12:25:23.110 INFO:tasks.workunit.client.0.smithi092.stdout:snap: orig 2024-09-15T12:25:23.110 INFO:tasks.workunit.client.0.smithi092.stdout:found orig with size 2097152 2024-09-15T12:25:23.110 INFO:tasks.workunit.client.0.smithi092.stdout:num snaps is: 0 2024-09-15T12:25:23.110 INFO:tasks.workunit.client.0.smithi092.stdout:expected: 0 2024-09-15T12:25:23.110 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestIOToSnapshot (3553 ms) 2024-09-15T12:25:23.110 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestSnapshotDeletedIo 2024-09-15T12:25:23.110 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:25.125 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestSnapshotDeletedIo (2016 ms) 2024-09-15T12:25:25.125 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestClone 2024-09-15T12:25:25.126 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6444: Skipped 2024-09-15T12:25:25.126 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:25.126 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestClone (0 ms) 2024-09-15T12:25:25.126 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestClone2 2024-09-15T12:25:25.126 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6608: Skipped 2024-09-15T12:25:25.126 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:25.126 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestClone2 (0 ms) 2024-09-15T12:25:25.126 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ListChildren 2024-09-15T12:25:25.126 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6841: Skipped 2024-09-15T12:25:25.126 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:25.126 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ListChildren (0 ms) 2024-09-15T12:25:25.126 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ListChildrenTiered 2024-09-15T12:25:25.127 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6995: Skipped 2024-09-15T12:25:25.127 INFO:tasks.workunit.client.0.smithi092.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:25:25.127 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered (0 ms) 2024-09-15T12:25:25.127 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.LockingPP 2024-09-15T12:25:25.127 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:25.542 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.LockingPP (417 ms) 2024-09-15T12:25:25.543 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.FlushAio 2024-09-15T12:25:25.543 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:28.148 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.FlushAio (2606 ms) 2024-09-15T12:25:28.148 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.FlushAioPP 2024-09-15T12:25:28.149 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:31.128 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.FlushAioPP (2980 ms) 2024-09-15T12:25:31.128 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ZeroLengthWrite 2024-09-15T12:25:31.128 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:31.236 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.ZeroLengthWrite (108 ms) 2024-09-15T12:25:31.236 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ZeroLengthDiscard 2024-09-15T12:25:31.236 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:31.354 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.ZeroLengthDiscard (118 ms) 2024-09-15T12:25:31.354 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ZeroLengthRead 2024-09-15T12:25:31.354 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:31.453 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.ZeroLengthRead (99 ms) 2024-09-15T12:25:31.453 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.LargeCacheRead 2024-09-15T12:25:31.453 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:31.594 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.LargeCacheRead (141 ms) 2024-09-15T12:25:31.595 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestPendingAio 2024-09-15T12:25:31.595 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9152: Skipped 2024-09-15T12:25:31.595 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:31.595 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestPendingAio (0 ms) 2024-09-15T12:25:31.595 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyup 2024-09-15T12:25:31.595 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9264: Skipped 2024-09-15T12:25:31.595 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:31.595 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyup (0 ms) 2024-09-15T12:25:31.595 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-09-15T12:25:31.595 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9325: Skipped 2024-09-15T12:25:31.595 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:31.595 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyupMismatch (0 ms) 2024-09-15T12:25:31.596 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.Flatten 2024-09-15T12:25:31.596 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9336: Skipped 2024-09-15T12:25:31.596 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:31.596 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.Flatten (0 ms) 2024-09-15T12:25:31.596 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.Sparsify 2024-09-15T12:25:31.596 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:31.745 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 32768 2024-09-15T12:25:31.745 INFO:tasks.workunit.client.0.smithi092.stdout:read: 32768 2024-09-15T12:25:31.745 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.Sparsify (151 ms) 2024-09-15T12:25:31.745 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.SparsifyPP 2024-09-15T12:25:31.745 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:31.906 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.SparsifyPP (161 ms) 2024-09-15T12:25:31.906 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.SnapshotLimit 2024-09-15T12:25:31.906 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:37.143 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.SnapshotLimit (5237 ms) 2024-09-15T12:25:37.143 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.SnapshotLimitPP 2024-09-15T12:25:37.144 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:42.174 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.SnapshotLimitPP (5030 ms) 2024-09-15T12:25:42.174 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-09-15T12:25:42.175 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9523: Skipped 2024-09-15T12:25:42.175 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.175 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.RebuildObjectMapViaLockOwner (0 ms) 2024-09-15T12:25:42.175 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.RenameViaLockOwner 2024-09-15T12:25:42.175 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9575: Skipped 2024-09-15T12:25:42.175 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.175 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.RenameViaLockOwner (0 ms) 2024-09-15T12:25:42.175 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.SnapCreateViaLockOwner 2024-09-15T12:25:42.175 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9615: Skipped 2024-09-15T12:25:42.175 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.175 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SnapCreateViaLockOwner (0 ms) 2024-09-15T12:25:42.175 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.SnapRemoveViaLockOwner 2024-09-15T12:25:42.176 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9659: Skipped 2024-09-15T12:25:42.176 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.176 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveViaLockOwner (0 ms) 2024-09-15T12:25:42.176 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-09-15T12:25:42.176 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9699: Skipped 2024-09-15T12:25:42.176 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.176 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.UpdateFeaturesViaLockOwner (0 ms) 2024-09-15T12:25:42.176 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-15T12:25:42.176 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9736: Skipped 2024-09-15T12:25:42.176 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.176 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner (0 ms) 2024-09-15T12:25:42.176 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.SnapRemove2 2024-09-15T12:25:42.176 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9777: Skipped 2024-09-15T12:25:42.177 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.177 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SnapRemove2 (0 ms) 2024-09-15T12:25:42.177 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.SnapRenameViaLockOwner 2024-09-15T12:25:42.177 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9823: Skipped 2024-09-15T12:25:42.177 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.177 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SnapRenameViaLockOwner (0 ms) 2024-09-15T12:25:42.177 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.SnapProtectViaLockOwner 2024-09-15T12:25:42.177 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9864: Skipped 2024-09-15T12:25:42.177 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.177 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SnapProtectViaLockOwner (0 ms) 2024-09-15T12:25:42.177 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.SnapUnprotectViaLockOwner 2024-09-15T12:25:42.177 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9905: Skipped 2024-09-15T12:25:42.177 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.177 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SnapUnprotectViaLockOwner (0 ms) 2024-09-15T12:25:42.178 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.FlattenViaLockOwner 2024-09-15T12:25:42.178 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9949: Skipped 2024-09-15T12:25:42.178 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.178 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.FlattenViaLockOwner (0 ms) 2024-09-15T12:25:42.178 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ResizeViaLockOwner 2024-09-15T12:25:42.178 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9997: Skipped 2024-09-15T12:25:42.178 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.178 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ResizeViaLockOwner (0 ms) 2024-09-15T12:25:42.178 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.SparsifyViaLockOwner 2024-09-15T12:25:42.178 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10033: Skipped 2024-09-15T12:25:42.178 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.178 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SparsifyViaLockOwner (0 ms) 2024-09-15T12:25:42.178 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ObjectMapConsistentSnap 2024-09-15T12:25:42.179 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10069: Skipped 2024-09-15T12:25:42.179 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.179 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ObjectMapConsistentSnap (0 ms) 2024-09-15T12:25:42.179 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.Metadata 2024-09-15T12:25:42.179 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10121: Skipped 2024-09-15T12:25:42.179 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.179 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.Metadata (0 ms) 2024-09-15T12:25:42.179 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.MetadataPP 2024-09-15T12:25:42.179 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10310: Skipped 2024-09-15T12:25:42.179 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.179 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.MetadataPP (0 ms) 2024-09-15T12:25:42.179 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.UpdateFeatures 2024-09-15T12:25:42.179 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10391: Skipped 2024-09-15T12:25:42.179 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.179 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.UpdateFeatures (0 ms) 2024-09-15T12:25:42.180 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.FeaturesBitmaskString 2024-09-15T12:25:42.180 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.FeaturesBitmaskString (0 ms) 2024-09-15T12:25:42.180 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.RebuildObjectMap 2024-09-15T12:25:42.180 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:42.271 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.RebuildObjectMap (98 ms) 2024-09-15T12:25:42.271 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.RebuildNewObjectMap 2024-09-15T12:25:42.271 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10584: Skipped 2024-09-15T12:25:42.271 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.271 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.RebuildNewObjectMap (0 ms) 2024-09-15T12:25:42.271 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.CheckObjectMap 2024-09-15T12:25:42.272 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10609: Skipped 2024-09-15T12:25:42.272 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.272 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.CheckObjectMap (0 ms) 2024-09-15T12:25:42.272 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.BlockingAIO 2024-09-15T12:25:42.272 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:42.388 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.BlockingAIO (117 ms) 2024-09-15T12:25:42.389 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ExclusiveLockTransition 2024-09-15T12:25:42.389 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10737: Skipped 2024-09-15T12:25:42.389 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.389 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockTransition (0 ms) 2024-09-15T12:25:42.389 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ExclusiveLockReadTransition 2024-09-15T12:25:42.389 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10793: Skipped 2024-09-15T12:25:42.389 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.389 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition (0 ms) 2024-09-15T12:25:42.389 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.CacheMayCopyOnWrite 2024-09-15T12:25:42.389 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10846: Skipped 2024-09-15T12:25:42.390 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:42.390 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.CacheMayCopyOnWrite (0 ms) 2024-09-15T12:25:42.390 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot 2024-09-15T12:25:42.390 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:43.198 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot (810 ms) 2024-09-15T12:25:43.198 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestImageOptions 2024-09-15T12:25:47.409 INFO:tasks.workunit.client.0.smithi092.stdout:0.00% done 2024-09-15T12:25:47.409 INFO:tasks.workunit.client.0.smithi092.stdout:100.00% done 2024-09-15T12:25:47.409 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestImageOptions (4211 ms) 2024-09-15T12:25:47.409 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestImageOptionsPP 2024-09-15T12:25:49.146 INFO:tasks.workunit.client.0.smithi092.stdout:0.00% done 2024-09-15T12:25:49.146 INFO:tasks.workunit.client.0.smithi092.stdout:100.00% done 2024-09-15T12:25:49.147 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestImageOptionsPP (1737 ms) 2024-09-15T12:25:49.147 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.EventSocketPipe 2024-09-15T12:25:49.147 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.EventSocketPipe (0 ms) 2024-09-15T12:25:49.147 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.EventSocketEventfd 2024-09-15T12:25:49.147 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.EventSocketEventfd (0 ms) 2024-09-15T12:25:49.147 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ImagePollIO 2024-09-15T12:25:49.147 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:49.430 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:25:49.430 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:25:49.430 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:25:49.430 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:25:49.430 INFO:tasks.workunit.client.0.smithi092.stdout:wrote: 512 2024-09-15T12:25:49.430 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:49.431 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:25:49.431 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:49.431 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:49.431 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:25:49.431 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:49.431 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:25:49.431 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:49.431 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:49.431 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:25:49.431 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:49.431 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:25:49.431 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:49.432 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:49.432 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:25:49.432 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:49.432 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:25:49.432 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:49.432 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:49.432 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:25:49.432 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:49.432 INFO:tasks.workunit.client.0.smithi092.stdout:started write 2024-09-15T12:25:49.432 INFO:tasks.workunit.client.0.smithi092.stdout:write completion cb called! 2024-09-15T12:25:49.432 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 0 2024-09-15T12:25:49.432 INFO:tasks.workunit.client.0.smithi092.stdout:finished write 2024-09-15T12:25:49.432 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:49.432 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:25:49.432 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:25:49.433 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:25:49.433 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:49.433 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:25:49.433 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:25:49.433 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:25:49.433 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:49.433 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:25:49.433 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:25:49.433 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:25:49.433 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:49.434 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:25:49.434 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:25:49.434 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:25:49.434 INFO:tasks.workunit.client.0.smithi092.stdout:created completion 2024-09-15T12:25:49.434 INFO:tasks.workunit.client.0.smithi092.stdout:started read 2024-09-15T12:25:49.434 INFO:tasks.workunit.client.0.smithi092.stdout:read completion cb called! 2024-09-15T12:25:49.434 INFO:tasks.workunit.client.0.smithi092.stdout:return value is: 512 2024-09-15T12:25:49.434 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.ImagePollIO (284 ms) 2024-09-15T12:25:49.434 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.Mirror 2024-09-15T12:25:49.485 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:49.522 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:49.858 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.Mirror (429 ms) 2024-09-15T12:25:49.858 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.MirrorPeerAttributes 2024-09-15T12:25:49.975 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.MirrorPeerAttributes (116 ms) 2024-09-15T12:25:49.976 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.CreateWithMirrorEnabled 2024-09-15T12:25:49.976 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11322: Skipped 2024-09-15T12:25:49.976 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:49.976 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.CreateWithMirrorEnabled (0 ms) 2024-09-15T12:25:49.976 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-09-15T12:25:49.976 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11364: Skipped 2024-09-15T12:25:49.976 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:49.976 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot (0 ms) 2024-09-15T12:25:49.976 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ExclusiveLock 2024-09-15T12:25:49.976 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11410: Skipped 2024-09-15T12:25:49.976 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:49.976 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLock (0 ms) 2024-09-15T12:25:49.976 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.BreakLock 2024-09-15T12:25:49.977 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11553: Skipped 2024-09-15T12:25:49.977 INFO:tasks.workunit.client.0.smithi092.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:25:49.977 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.BreakLock (0 ms) 2024-09-15T12:25:49.977 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.DiscardAfterWrite 2024-09-15T12:25:49.977 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:50.099 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.DiscardAfterWrite (123 ms) 2024-09-15T12:25:50.099 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.DefaultFeatures 2024-09-15T12:25:50.099 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.DefaultFeatures (0 ms) 2024-09-15T12:25:50.099 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurge 2024-09-15T12:25:50.099 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11676: Skipped 2024-09-15T12:25:50.099 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:50.099 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurge (0 ms) 2024-09-15T12:25:50.099 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-09-15T12:25:50.099 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11722: Skipped 2024-09-15T12:25:50.099 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:50.099 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay (0 ms) 2024-09-15T12:25:50.099 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestTrashPurge 2024-09-15T12:25:50.100 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11753: Skipped 2024-09-15T12:25:50.100 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:50.100 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestTrashPurge (0 ms) 2024-09-15T12:25:50.100 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndRestore 2024-09-15T12:25:50.100 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11810: Skipped 2024-09-15T12:25:50.100 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:50.100 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndRestore (0 ms) 2024-09-15T12:25:50.100 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestListWatchers 2024-09-15T12:25:50.100 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestListWatchers (229 ms) 2024-09-15T12:25:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestSetSnapById 2024-09-15T12:25:50.327 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:51.184 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.TestSetSnapById (857 ms) 2024-09-15T12:25:51.185 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.Namespaces 2024-09-15T12:25:51.416 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.Namespaces (232 ms) 2024-09-15T12:25:51.416 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.NamespacesPP 2024-09-15T12:25:51.720 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:51.733 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.NamespacesPP (317 ms) 2024-09-15T12:25:51.733 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.Migration 2024-09-15T12:25:51.733 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:51.733 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:55.226 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.Migration (3493 ms) 2024-09-15T12:25:55.226 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.MigrationPP 2024-09-15T12:25:55.226 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:55.226 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:25:58.515 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.MigrationPP (3288 ms) 2024-09-15T12:25:58.515 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestGetAccessTimestamp 2024-09-15T12:25:58.515 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12177: Skipped 2024-09-15T12:25:58.515 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:58.515 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestGetAccessTimestamp (0 ms) 2024-09-15T12:25:58.515 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.TestGetModifyTimestamp 2024-09-15T12:25:58.516 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12202: Skipped 2024-09-15T12:25:58.516 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:58.516 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestGetModifyTimestamp (0 ms) 2024-09-15T12:25:58.516 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ZeroOverlapFlatten 2024-09-15T12:25:58.516 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12225: Skipped 2024-09-15T12:25:58.516 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:58.516 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ZeroOverlapFlatten (0 ms) 2024-09-15T12:25:58.516 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.PoolMetadata 2024-09-15T12:25:58.516 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12258: Skipped 2024-09-15T12:25:58.516 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:58.516 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.PoolMetadata (0 ms) 2024-09-15T12:25:58.516 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.PoolMetadataPP 2024-09-15T12:25:58.516 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12370: Skipped 2024-09-15T12:25:58.517 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:58.517 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.PoolMetadataPP (0 ms) 2024-09-15T12:25:58.517 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.Config 2024-09-15T12:25:58.517 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12422: Skipped 2024-09-15T12:25:58.517 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:58.517 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.Config (0 ms) 2024-09-15T12:25:58.517 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ConfigPP 2024-09-15T12:25:58.517 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12506: Skipped 2024-09-15T12:25:58.517 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:58.517 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ConfigPP (0 ms) 2024-09-15T12:25:58.517 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.PoolStatsPP 2024-09-15T12:25:58.517 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12583: Skipped 2024-09-15T12:25:58.517 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:58.517 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.PoolStatsPP (0 ms) 2024-09-15T12:25:58.518 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ImageSpec 2024-09-15T12:25:58.518 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12658: Skipped 2024-09-15T12:25:58.518 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:58.518 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ImageSpec (0 ms) 2024-09-15T12:25:58.518 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.SnapRemoveWithChildMissing 2024-09-15T12:25:58.518 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12853: Skipped 2024-09-15T12:25:58.518 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:25:58.518 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveWithChildMissing (0 ms) 2024-09-15T12:25:58.518 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.QuiesceWatch 2024-09-15T12:25:58.518 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:26:04.075 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.QuiesceWatch (5561 ms) 2024-09-15T12:26:04.076 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.QuiesceWatchPP 2024-09-15T12:26:04.076 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:26:10.085 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.QuiesceWatchPP (6009 ms) 2024-09-15T12:26:10.085 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.QuiesceWatchError 2024-09-15T12:26:10.085 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13115: Skipped 2024-09-15T12:26:10.085 INFO:tasks.workunit.client.0.smithi092.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:26:10.085 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError (0 ms) 2024-09-15T12:26:10.085 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.QuiesceWatchTimeout 2024-09-15T12:26:10.085 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:26:10.170 INFO:tasks.workunit.client.0.smithi092.stderr:test quiesce is not long enough to time out 2024-09-15T12:26:18.995 INFO:tasks.workunit.client.0.smithi092.stderr:test quiesce is timed out 2024-09-15T12:26:19.011 INFO:tasks.workunit.client.0.smithi092.stderr:waiting for timed out ... 0 2024-09-15T12:26:20.012 INFO:tasks.workunit.client.0.smithi092.stderr:waiting for timed out ... 1 2024-09-15T12:26:21.012 INFO:tasks.workunit.client.0.smithi092.stderr:waiting for timed out ... 2 2024-09-15T12:26:22.012 INFO:tasks.workunit.client.0.smithi092.stderr:waiting for timed out ... 3 2024-09-15T12:26:23.012 INFO:tasks.workunit.client.0.smithi092.stderr:waiting for timed out ... 4 2024-09-15T12:26:24.012 INFO:tasks.workunit.client.0.smithi092.stderr:waiting for timed out ... 5 2024-09-15T12:26:25.012 INFO:tasks.workunit.client.0.smithi092.stderr:waiting for timed out ... 6 2024-09-15T12:26:26.013 INFO:tasks.workunit.client.0.smithi092.stderr:waiting for timed out ... 7 2024-09-15T12:26:27.013 INFO:tasks.workunit.client.0.smithi092.stderr:waiting for timed out ... 8 2024-09-15T12:26:28.013 INFO:tasks.workunit.client.0.smithi092.stderr:waiting for timed out ... 9 2024-09-15T12:26:29.013 INFO:tasks.workunit.client.0.smithi092.stderr:waiting for timed out ... 10 2024-09-15T12:26:40.014 INFO:tasks.workunit.client.0.smithi092.stderr:test retry succeeds 2024-09-15T12:26:43.135 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.QuiesceWatchTimeout (33051 ms) 2024-09-15T12:26:43.135 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.WriteZeroes 2024-09-15T12:26:43.135 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:26:43.320 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.WriteZeroes (185 ms) 2024-09-15T12:26:43.320 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.WriteZeroesThickProvision 2024-09-15T12:26:43.320 INFO:tasks.workunit.client.0.smithi092.stdout:using old format 2024-09-15T12:26:43.578 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestLibRBD.WriteZeroesThickProvision (258 ms) 2024-09-15T12:26:43.579 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.ConcurrentOperations 2024-09-15T12:26:43.579 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13474: Skipped 2024-09-15T12:26:43.579 INFO:tasks.workunit.client.0.smithi092.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:26:43.579 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations (0 ms) 2024-09-15T12:26:43.579 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestLibRBD.FormatAndCloneFormatOptions 2024-09-15T12:26:43.579 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13630: Skipped 2024-09-15T12:26:43.579 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:43.579 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.FormatAndCloneFormatOptions (0 ms) 2024-09-15T12:26:49.849 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 171 tests from TestLibRBD (496798 ms total) 2024-09-15T12:26:49.849 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:26:49.849 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:26:49.849 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 171 tests from 1 test suite ran. (503115 ms total) 2024-09-15T12:26:49.849 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 104 tests. 2024-09-15T12:26:49.850 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 67 tests, listed below: 2024-09-15T12:26:49.850 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.CreateWithSameDataPool 2024-09-15T12:26:49.850 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestGetCreateTimestamp 2024-09-15T12:26:49.850 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.GetCreateTimestampPP 2024-09-15T12:26:49.850 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopy 2024-09-15T12:26:49.850 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopyPP 2024-09-15T12:26:49.850 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestGetSnapShotTimeStamp 2024-09-15T12:26:49.850 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryDataPool 2024-09-15T12:26:49.850 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespace 2024-09-15T12:26:49.850 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespaceDataPool 2024-09-15T12:26:49.850 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestCloneEncryption 2024-09-15T12:26:49.850 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.LUKS1UnderLUKS2WithoutResize 2024-09-15T12:26:49.850 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.LUKS2UnderLUKS1WithoutResize 2024-09-15T12:26:49.850 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-15T12:26:49.850 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadFormatMismatch 2024-09-15T12:26:49.851 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.EncryptedFlattenSmallData 2024-09-15T12:26:49.851 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestDataPoolIO 2024-09-15T12:26:49.851 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestClone 2024-09-15T12:26:49.851 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestClone2 2024-09-15T12:26:49.851 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ListChildren 2024-09-15T12:26:49.851 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered 2024-09-15T12:26:49.851 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestPendingAio 2024-09-15T12:26:49.851 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyup 2024-09-15T12:26:49.851 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-09-15T12:26:49.851 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.Flatten 2024-09-15T12:26:49.851 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-09-15T12:26:49.851 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.RenameViaLockOwner 2024-09-15T12:26:49.851 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SnapCreateViaLockOwner 2024-09-15T12:26:49.851 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveViaLockOwner 2024-09-15T12:26:49.851 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-09-15T12:26:49.852 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-15T12:26:49.852 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SnapRemove2 2024-09-15T12:26:49.852 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SnapRenameViaLockOwner 2024-09-15T12:26:49.852 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SnapProtectViaLockOwner 2024-09-15T12:26:49.852 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SnapUnprotectViaLockOwner 2024-09-15T12:26:49.852 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.FlattenViaLockOwner 2024-09-15T12:26:49.852 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ResizeViaLockOwner 2024-09-15T12:26:49.852 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SparsifyViaLockOwner 2024-09-15T12:26:49.852 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ObjectMapConsistentSnap 2024-09-15T12:26:49.852 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.Metadata 2024-09-15T12:26:49.852 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.MetadataPP 2024-09-15T12:26:49.852 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.UpdateFeatures 2024-09-15T12:26:49.852 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.RebuildNewObjectMap 2024-09-15T12:26:49.852 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.CheckObjectMap 2024-09-15T12:26:49.853 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockTransition 2024-09-15T12:26:49.853 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition 2024-09-15T12:26:49.853 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.CacheMayCopyOnWrite 2024-09-15T12:26:49.853 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.CreateWithMirrorEnabled 2024-09-15T12:26:49.853 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-09-15T12:26:49.853 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLock 2024-09-15T12:26:49.853 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.BreakLock 2024-09-15T12:26:49.853 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurge 2024-09-15T12:26:49.853 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-09-15T12:26:49.853 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestTrashPurge 2024-09-15T12:26:49.853 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndRestore 2024-09-15T12:26:49.853 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestGetAccessTimestamp 2024-09-15T12:26:49.853 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.TestGetModifyTimestamp 2024-09-15T12:26:49.853 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ZeroOverlapFlatten 2024-09-15T12:26:49.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.PoolMetadata 2024-09-15T12:26:49.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.PoolMetadataPP 2024-09-15T12:26:49.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.Config 2024-09-15T12:26:49.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ConfigPP 2024-09-15T12:26:49.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.PoolStatsPP 2024-09-15T12:26:49.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ImageSpec 2024-09-15T12:26:49.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveWithChildMissing 2024-09-15T12:26:49.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError 2024-09-15T12:26:49.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations 2024-09-15T12:26:49.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestLibRBD.FormatAndCloneFormatOptions 2024-09-15T12:26:49.854 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:26:49.854 INFO:tasks.workunit.client.0.smithi092.stdout: YOU HAVE 1 DISABLED TEST 2024-09-15T12:26:49.854 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:26:49.918 INFO:tasks.workunit.client.0.smithi092.stdout:seed 33001 2024-09-15T12:26:49.918 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = EncryptedFlattenTest/0.* 2024-09-15T12:26:49.918 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:26:49.919 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:26:49.919 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/0, where TypeParam = PlaintextUnderLUKS1 2024-09-15T12:26:49.998 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/0.Simple 2024-09-15T12:26:51.868 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:26:51.868 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:51.868 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Simple (1868 ms) 2024-09-15T12:26:51.868 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/0.Grow 2024-09-15T12:26:51.868 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:26:51.868 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:51.868 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Grow (0 ms) 2024-09-15T12:26:51.868 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/0.Shrink 2024-09-15T12:26:51.868 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:26:51.869 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:51.869 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Shrink (0 ms) 2024-09-15T12:26:51.869 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOne 2024-09-15T12:26:51.869 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:26:51.869 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:51.869 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOne (0 ms) 2024-09-15T12:26:51.869 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot 2024-09-15T12:26:51.869 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:26:51.869 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:51.870 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:26:51.870 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/0.MinOverlap 2024-09-15T12:26:51.870 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:26:51.870 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:51.870 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/0.MinOverlap (0 ms) 2024-09-15T12:26:51.870 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/0.ZeroOverlap 2024-09-15T12:26:51.870 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:26:51.870 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:51.870 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ZeroOverlap (0 ms) 2024-09-15T12:26:52.871 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/0 (1868 ms total) 2024-09-15T12:26:52.871 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:26:52.871 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:26:52.871 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 7 tests from 1 test suite ran. (2952 ms total) 2024-09-15T12:26:52.871 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 0 tests. 2024-09-15T12:26:52.871 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:26:52.871 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Simple 2024-09-15T12:26:52.871 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Grow 2024-09-15T12:26:52.871 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Shrink 2024-09-15T12:26:52.872 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOne 2024-09-15T12:26:52.872 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot 2024-09-15T12:26:52.872 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/0.MinOverlap 2024-09-15T12:26:52.872 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ZeroOverlap 2024-09-15T12:26:52.952 INFO:tasks.workunit.client.0.smithi092.stdout:seed 33065 2024-09-15T12:26:52.953 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = EncryptedFlattenTest/1.* 2024-09-15T12:26:52.953 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:26:52.953 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:26:52.953 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/1, where TypeParam = PlaintextUnderLUKS2 2024-09-15T12:26:53.054 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/1.Simple 2024-09-15T12:26:54.879 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:26:54.879 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:54.879 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Simple (1825 ms) 2024-09-15T12:26:54.879 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/1.Grow 2024-09-15T12:26:54.879 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:26:54.880 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:54.880 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Grow (0 ms) 2024-09-15T12:26:54.880 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/1.Shrink 2024-09-15T12:26:54.880 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:26:54.880 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:54.880 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Shrink (0 ms) 2024-09-15T12:26:54.880 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOne 2024-09-15T12:26:54.880 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:26:54.880 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:54.880 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOne (0 ms) 2024-09-15T12:26:54.880 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot 2024-09-15T12:26:54.881 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:26:54.881 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:54.881 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:26:54.881 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/1.MinOverlap 2024-09-15T12:26:54.881 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:26:54.881 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:54.881 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/1.MinOverlap (0 ms) 2024-09-15T12:26:54.881 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/1.ZeroOverlap 2024-09-15T12:26:54.881 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:26:54.881 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:54.881 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ZeroOverlap (0 ms) 2024-09-15T12:26:55.880 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/1 (1825 ms total) 2024-09-15T12:26:55.880 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:26:55.880 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:26:55.880 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 7 tests from 1 test suite ran. (2927 ms total) 2024-09-15T12:26:55.880 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 0 tests. 2024-09-15T12:26:55.880 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:26:55.880 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Simple 2024-09-15T12:26:55.881 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Grow 2024-09-15T12:26:55.881 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Shrink 2024-09-15T12:26:55.881 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOne 2024-09-15T12:26:55.881 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot 2024-09-15T12:26:55.881 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/1.MinOverlap 2024-09-15T12:26:55.881 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ZeroOverlap 2024-09-15T12:26:55.975 INFO:tasks.workunit.client.0.smithi092.stdout:seed 33129 2024-09-15T12:26:55.975 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = EncryptedFlattenTest/2.* 2024-09-15T12:26:55.975 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:26:55.975 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:26:55.975 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/2, where TypeParam = UnformattedLUKS1 2024-09-15T12:26:56.062 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/2.Simple 2024-09-15T12:26:57.895 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:26:57.895 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:57.895 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Simple (1833 ms) 2024-09-15T12:26:57.895 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/2.Grow 2024-09-15T12:26:57.895 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:26:57.896 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:57.896 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Grow (0 ms) 2024-09-15T12:26:57.896 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/2.Shrink 2024-09-15T12:26:57.896 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:26:57.896 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:57.896 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Shrink (0 ms) 2024-09-15T12:26:57.896 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOne 2024-09-15T12:26:57.896 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:26:57.896 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:57.896 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOne (0 ms) 2024-09-15T12:26:57.896 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot 2024-09-15T12:26:57.896 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:26:57.896 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:57.896 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:26:57.897 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/2.MinOverlap 2024-09-15T12:26:57.897 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:26:57.897 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:57.897 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/2.MinOverlap (0 ms) 2024-09-15T12:26:57.897 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/2.ZeroOverlap 2024-09-15T12:26:57.897 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:26:57.897 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:57.897 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ZeroOverlap (0 ms) 2024-09-15T12:26:58.904 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/2 (1833 ms total) 2024-09-15T12:26:58.904 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:26:58.904 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:26:58.904 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 7 tests from 1 test suite ran. (2929 ms total) 2024-09-15T12:26:58.904 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 0 tests. 2024-09-15T12:26:58.904 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:26:58.904 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Simple 2024-09-15T12:26:58.904 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Grow 2024-09-15T12:26:58.904 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Shrink 2024-09-15T12:26:58.904 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOne 2024-09-15T12:26:58.905 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot 2024-09-15T12:26:58.905 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/2.MinOverlap 2024-09-15T12:26:58.905 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ZeroOverlap 2024-09-15T12:26:58.996 INFO:tasks.workunit.client.0.smithi092.stdout:seed 33193 2024-09-15T12:26:58.997 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = EncryptedFlattenTest/3.* 2024-09-15T12:26:58.997 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:26:58.997 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:26:58.997 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/3, where TypeParam = LUKS1UnderLUKS1 2024-09-15T12:26:59.071 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/3.Simple 2024-09-15T12:27:00.917 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:27:00.917 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:00.917 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Simple (1844 ms) 2024-09-15T12:27:00.917 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/3.Grow 2024-09-15T12:27:00.917 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:27:00.917 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:00.917 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Grow (0 ms) 2024-09-15T12:27:00.917 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/3.Shrink 2024-09-15T12:27:00.917 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:27:00.917 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:00.917 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Shrink (0 ms) 2024-09-15T12:27:00.917 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOne 2024-09-15T12:27:00.917 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:27:00.918 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:00.918 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOne (0 ms) 2024-09-15T12:27:00.918 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot 2024-09-15T12:27:00.918 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:27:00.918 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:00.918 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:27:00.918 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/3.MinOverlap 2024-09-15T12:27:00.918 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:27:00.918 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:00.918 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/3.MinOverlap (0 ms) 2024-09-15T12:27:00.918 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/3.ZeroOverlap 2024-09-15T12:27:00.918 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:27:00.918 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:00.918 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ZeroOverlap (0 ms) 2024-09-15T12:27:01.921 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/3 (1844 ms total) 2024-09-15T12:27:01.921 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:27:01.921 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:01.921 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 7 tests from 1 test suite ran. (2924 ms total) 2024-09-15T12:27:01.921 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 0 tests. 2024-09-15T12:27:01.921 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:27:01.921 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Simple 2024-09-15T12:27:01.921 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Grow 2024-09-15T12:27:01.922 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Shrink 2024-09-15T12:27:01.922 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOne 2024-09-15T12:27:01.922 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot 2024-09-15T12:27:01.922 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/3.MinOverlap 2024-09-15T12:27:01.922 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ZeroOverlap 2024-09-15T12:27:02.004 INFO:tasks.workunit.client.0.smithi092.stdout:seed 33257 2024-09-15T12:27:02.005 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = EncryptedFlattenTest/4.* 2024-09-15T12:27:02.005 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:27:02.005 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:02.005 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/4, where TypeParam = LUKS1UnderLUKS2 2024-09-15T12:27:02.092 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/4.Simple 2024-09-15T12:27:03.926 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Simple (1834 ms) 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/4.Grow 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Grow (0 ms) 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/4.Shrink 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Shrink (0 ms) 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOne 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOne (0 ms) 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot 2024-09-15T12:27:03.927 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:27:03.928 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:03.928 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:27:03.928 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/4.MinOverlap 2024-09-15T12:27:03.928 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:27:03.928 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:03.928 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/4.MinOverlap (0 ms) 2024-09-15T12:27:03.928 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/4.ZeroOverlap 2024-09-15T12:27:03.928 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:27:03.928 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:03.928 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ZeroOverlap (0 ms) 2024-09-15T12:27:04.938 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/4 (1834 ms total) 2024-09-15T12:27:04.938 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:27:04.938 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:04.939 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 7 tests from 1 test suite ran. (2933 ms total) 2024-09-15T12:27:04.939 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 0 tests. 2024-09-15T12:27:04.939 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:27:04.939 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Simple 2024-09-15T12:27:04.939 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Grow 2024-09-15T12:27:04.939 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Shrink 2024-09-15T12:27:04.939 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOne 2024-09-15T12:27:04.939 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot 2024-09-15T12:27:04.939 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/4.MinOverlap 2024-09-15T12:27:04.939 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ZeroOverlap 2024-09-15T12:27:05.034 INFO:tasks.workunit.client.0.smithi092.stdout:seed 33321 2024-09-15T12:27:05.034 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = EncryptedFlattenTest/5.* 2024-09-15T12:27:05.034 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:27:05.034 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:05.034 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/5, where TypeParam = UnformattedLUKS2 2024-09-15T12:27:05.115 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/5.Simple 2024-09-15T12:27:06.784 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:27:06.784 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:06.784 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Simple (1668 ms) 2024-09-15T12:27:06.784 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/5.Grow 2024-09-15T12:27:06.784 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:27:06.784 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:06.784 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Grow (0 ms) 2024-09-15T12:27:06.784 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/5.Shrink 2024-09-15T12:27:06.784 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:27:06.784 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:06.785 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Shrink (0 ms) 2024-09-15T12:27:06.785 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOne 2024-09-15T12:27:06.785 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:27:06.785 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:06.785 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOne (0 ms) 2024-09-15T12:27:06.785 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot 2024-09-15T12:27:06.785 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:27:06.785 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:06.785 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:27:06.785 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/5.MinOverlap 2024-09-15T12:27:06.785 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:27:06.785 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:06.785 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/5.MinOverlap (0 ms) 2024-09-15T12:27:06.785 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/5.ZeroOverlap 2024-09-15T12:27:06.786 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:27:06.786 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:06.786 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ZeroOverlap (0 ms) 2024-09-15T12:27:07.787 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/5 (1669 ms total) 2024-09-15T12:27:07.787 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:27:07.787 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:07.787 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 7 tests from 1 test suite ran. (2753 ms total) 2024-09-15T12:27:07.787 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 0 tests. 2024-09-15T12:27:07.787 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:27:07.787 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Simple 2024-09-15T12:27:07.788 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Grow 2024-09-15T12:27:07.788 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Shrink 2024-09-15T12:27:07.788 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOne 2024-09-15T12:27:07.788 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot 2024-09-15T12:27:07.788 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/5.MinOverlap 2024-09-15T12:27:07.788 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ZeroOverlap 2024-09-15T12:27:07.898 INFO:tasks.workunit.client.0.smithi092.stdout:seed 33385 2024-09-15T12:27:07.898 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = EncryptedFlattenTest/6.* 2024-09-15T12:27:07.898 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:27:07.899 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:07.899 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/6, where TypeParam = LUKS2UnderLUKS2 2024-09-15T12:27:07.971 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/6.Simple 2024-09-15T12:27:09.801 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:27:09.801 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:09.801 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Simple (1830 ms) 2024-09-15T12:27:09.801 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/6.Grow 2024-09-15T12:27:09.802 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:27:09.802 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:09.802 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Grow (0 ms) 2024-09-15T12:27:09.802 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/6.Shrink 2024-09-15T12:27:09.802 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:27:09.802 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:09.802 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Shrink (0 ms) 2024-09-15T12:27:09.802 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOne 2024-09-15T12:27:09.802 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:27:09.802 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:09.802 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOne (0 ms) 2024-09-15T12:27:09.802 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot 2024-09-15T12:27:09.802 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:27:09.803 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:09.803 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:27:09.803 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/6.MinOverlap 2024-09-15T12:27:09.803 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:27:09.803 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:09.803 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/6.MinOverlap (0 ms) 2024-09-15T12:27:09.803 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/6.ZeroOverlap 2024-09-15T12:27:09.803 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:27:09.803 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:09.803 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ZeroOverlap (0 ms) 2024-09-15T12:27:10.782 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/6 (1830 ms total) 2024-09-15T12:27:10.782 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:27:10.782 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:10.782 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 7 tests from 1 test suite ran. (2884 ms total) 2024-09-15T12:27:10.782 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 0 tests. 2024-09-15T12:27:10.782 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:27:10.783 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Simple 2024-09-15T12:27:10.783 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Grow 2024-09-15T12:27:10.783 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Shrink 2024-09-15T12:27:10.783 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOne 2024-09-15T12:27:10.783 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot 2024-09-15T12:27:10.783 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/6.MinOverlap 2024-09-15T12:27:10.783 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ZeroOverlap 2024-09-15T12:27:10.870 INFO:tasks.workunit.client.0.smithi092.stdout:seed 33449 2024-09-15T12:27:10.870 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = EncryptedFlattenTest/7.* 2024-09-15T12:27:10.870 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:27:10.870 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:10.870 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/7, where TypeParam = LUKS2UnderLUKS1 2024-09-15T12:27:10.956 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/7.Simple 2024-09-15T12:27:12.829 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:27:12.829 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:12.829 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Simple (1869 ms) 2024-09-15T12:27:12.829 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/7.Grow 2024-09-15T12:27:12.830 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:27:12.830 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:12.830 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Grow (0 ms) 2024-09-15T12:27:12.830 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/7.Shrink 2024-09-15T12:27:12.830 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:27:12.830 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:12.830 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Shrink (0 ms) 2024-09-15T12:27:12.830 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOne 2024-09-15T12:27:12.830 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:27:12.830 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:12.830 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOne (0 ms) 2024-09-15T12:27:12.830 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot 2024-09-15T12:27:12.830 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:27:12.830 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:12.830 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:27:12.831 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/7.MinOverlap 2024-09-15T12:27:12.831 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:27:12.831 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:12.831 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/7.MinOverlap (0 ms) 2024-09-15T12:27:12.831 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] EncryptedFlattenTest/7.ZeroOverlap 2024-09-15T12:27:12.831 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:27:12.831 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:12.831 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ZeroOverlap (0 ms) 2024-09-15T12:27:13.824 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 7 tests from EncryptedFlattenTest/7 (1869 ms total) 2024-09-15T12:27:13.824 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:27:13.824 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:13.824 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 7 tests from 1 test suite ran. (2954 ms total) 2024-09-15T12:27:13.824 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 0 tests. 2024-09-15T12:27:13.824 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:27:13.824 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Simple 2024-09-15T12:27:13.824 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Grow 2024-09-15T12:27:13.824 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Shrink 2024-09-15T12:27:13.824 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOne 2024-09-15T12:27:13.825 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot 2024-09-15T12:27:13.825 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/7.MinOverlap 2024-09-15T12:27:13.825 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ZeroOverlap 2024-09-15T12:27:13.897 INFO:tasks.workunit.client.0.smithi092.stdout:seed 33513 2024-09-15T12:27:13.898 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = TestImageWatcher.* 2024-09-15T12:27:13.898 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-15T12:27:13.898 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:13.898 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 17 tests from TestImageWatcher 2024-09-15T12:27:15.839 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifyHeaderUpdate 2024-09-15T12:27:17.922 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:460: Skipped 2024-09-15T12:27:17.922 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:17.922 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyHeaderUpdate (2083 ms) 2024-09-15T12:27:17.922 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifyFlatten 2024-09-15T12:27:17.959 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:478: Skipped 2024-09-15T12:27:17.959 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:17.959 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyFlatten (37 ms) 2024-09-15T12:27:17.959 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifyResize 2024-09-15T12:27:17.993 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:512: Skipped 2024-09-15T12:27:17.993 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:17.994 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyResize (35 ms) 2024-09-15T12:27:17.994 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifyRebuildObjectMap 2024-09-15T12:27:18.030 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:546: Skipped 2024-09-15T12:27:18.030 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:18.031 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyRebuildObjectMap (37 ms) 2024-09-15T12:27:18.031 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifyUpdateFeatures 2024-09-15T12:27:18.067 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:581: Skipped 2024-09-15T12:27:18.067 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:18.067 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyUpdateFeatures (36 ms) 2024-09-15T12:27:18.067 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifySnapCreate 2024-09-15T12:27:18.102 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:611: Skipped 2024-09-15T12:27:18.102 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:18.102 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreate (35 ms) 2024-09-15T12:27:18.102 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifySnapCreateError 2024-09-15T12:27:18.142 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:646: Skipped 2024-09-15T12:27:18.142 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:18.142 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreateError (40 ms) 2024-09-15T12:27:18.142 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifySnapRename 2024-09-15T12:27:18.179 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:670: Skipped 2024-09-15T12:27:18.179 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:18.179 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRename (37 ms) 2024-09-15T12:27:18.179 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifySnapRenameError 2024-09-15T12:27:18.216 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:701: Skipped 2024-09-15T12:27:18.216 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:18.217 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRenameError (38 ms) 2024-09-15T12:27:18.217 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifySnapRemove 2024-09-15T12:27:18.254 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:723: Skipped 2024-09-15T12:27:18.254 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:18.254 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRemove (37 ms) 2024-09-15T12:27:18.254 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifySnapProtect 2024-09-15T12:27:18.290 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:754: Skipped 2024-09-15T12:27:18.290 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:18.290 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapProtect (37 ms) 2024-09-15T12:27:18.291 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifySnapUnprotect 2024-09-15T12:27:18.328 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:785: Skipped 2024-09-15T12:27:18.328 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:18.329 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapUnprotect (37 ms) 2024-09-15T12:27:18.329 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifyRename 2024-09-15T12:27:18.365 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:816: Skipped 2024-09-15T12:27:18.365 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:18.365 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyRename (37 ms) 2024-09-15T12:27:18.365 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifyAsyncTimedOut 2024-09-15T12:27:18.401 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:847: Skipped 2024-09-15T12:27:18.402 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:18.402 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncTimedOut (37 ms) 2024-09-15T12:27:18.402 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifyAsyncError 2024-09-15T12:27:18.442 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:867: Skipped 2024-09-15T12:27:18.443 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:18.443 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncError (41 ms) 2024-09-15T12:27:18.443 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifyAsyncCompleteError 2024-09-15T12:27:18.482 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:887: Skipped 2024-09-15T12:27:18.482 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:18.482 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncCompleteError (40 ms) 2024-09-15T12:27:18.483 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-09-15T12:27:18.519 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:918: Skipped 2024-09-15T12:27:18.519 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:18.520 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncRequestTimedOut (36 ms) 2024-09-15T12:27:18.854 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 17 tests from TestImageWatcher (2680 ms total) 2024-09-15T12:27:18.854 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:27:18.854 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:18.854 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 17 tests from 1 test suite ran. (4956 ms total) 2024-09-15T12:27:18.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 0 tests. 2024-09-15T12:27:18.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 17 tests, listed below: 2024-09-15T12:27:18.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyHeaderUpdate 2024-09-15T12:27:18.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyFlatten 2024-09-15T12:27:18.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyResize 2024-09-15T12:27:18.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyRebuildObjectMap 2024-09-15T12:27:18.854 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyUpdateFeatures 2024-09-15T12:27:18.855 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreate 2024-09-15T12:27:18.855 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreateError 2024-09-15T12:27:18.855 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRename 2024-09-15T12:27:18.855 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRenameError 2024-09-15T12:27:18.855 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRemove 2024-09-15T12:27:18.855 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapProtect 2024-09-15T12:27:18.855 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapUnprotect 2024-09-15T12:27:18.855 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyRename 2024-09-15T12:27:18.855 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncTimedOut 2024-09-15T12:27:18.855 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncError 2024-09-15T12:27:18.855 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncCompleteError 2024-09-15T12:27:18.855 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-09-15T12:27:18.953 INFO:tasks.workunit.client.0.smithi092.stdout:seed 33562 2024-09-15T12:27:18.954 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = TestInternal.* 2024-09-15T12:27:18.954 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 34 tests from 1 test suite. 2024-09-15T12:27:18.955 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:18.955 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 34 tests from TestInternal 2024-09-15T12:27:20.782 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.OpenByID 2024-09-15T12:27:22.953 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:176: Skipped 2024-09-15T12:27:22.953 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:22.953 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.OpenByID (2171 ms) 2024-09-15T12:27:22.954 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.OpenSnapDNE 2024-09-15T12:27:23.068 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestInternal.OpenSnapDNE (115 ms) 2024-09-15T12:27:23.068 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.IsExclusiveLockOwner 2024-09-15T12:27:23.115 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:198: Skipped 2024-09-15T12:27:23.115 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:23.115 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.IsExclusiveLockOwner (47 ms) 2024-09-15T12:27:23.115 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.ResizeLocksImage 2024-09-15T12:27:23.153 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:218: Skipped 2024-09-15T12:27:23.153 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:23.153 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.ResizeLocksImage (38 ms) 2024-09-15T12:27:23.153 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.ResizeFailsToLockImage 2024-09-15T12:27:23.190 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:232: Skipped 2024-09-15T12:27:23.190 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:23.190 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.ResizeFailsToLockImage (37 ms) 2024-09-15T12:27:23.190 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.SnapCreateLocksImage 2024-09-15T12:27:23.232 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:243: Skipped 2024-09-15T12:27:23.233 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:23.233 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapCreateLocksImage (43 ms) 2024-09-15T12:27:23.233 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.SnapCreateFailsToLockImage 2024-09-15T12:27:23.270 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:261: Skipped 2024-09-15T12:27:23.270 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:23.270 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapCreateFailsToLockImage (37 ms) 2024-09-15T12:27:23.270 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.SnapRollbackLocksImage 2024-09-15T12:27:23.308 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:271: Skipped 2024-09-15T12:27:23.308 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:23.308 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapRollbackLocksImage (38 ms) 2024-09-15T12:27:23.308 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.SnapRollbackFailsToLockImage 2024-09-15T12:27:23.345 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:289: Skipped 2024-09-15T12:27:23.345 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:23.345 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapRollbackFailsToLockImage (38 ms) 2024-09-15T12:27:23.346 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.SnapSetReleasesLock 2024-09-15T12:27:23.382 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:306: Skipped 2024-09-15T12:27:23.383 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:23.383 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapSetReleasesLock (37 ms) 2024-09-15T12:27:23.383 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.FlattenLocksImage 2024-09-15T12:27:23.420 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:321: Skipped 2024-09-15T12:27:23.420 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:23.420 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.FlattenLocksImage (37 ms) 2024-09-15T12:27:23.420 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.FlattenFailsToLockImage 2024-09-15T12:27:23.456 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:348: Skipped 2024-09-15T12:27:23.456 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:23.456 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.FlattenFailsToLockImage (36 ms) 2024-09-15T12:27:23.456 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-15T12:27:23.493 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:382: Skipped 2024-09-15T12:27:23.493 INFO:tasks.workunit.client.0.smithi092.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:23.493 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted (37 ms) 2024-09-15T12:27:23.493 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-15T12:27:23.530 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:416: Skipped 2024-09-15T12:27:23.531 INFO:tasks.workunit.client.0.smithi092.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:23.531 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch (38 ms) 2024-09-15T12:27:23.531 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.AioWriteRequestsLock 2024-09-15T12:27:23.567 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:455: Skipped 2024-09-15T12:27:23.567 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:23.568 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.AioWriteRequestsLock (36 ms) 2024-09-15T12:27:23.568 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.AioDiscardRequestsLock 2024-09-15T12:27:23.604 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:481: Skipped 2024-09-15T12:27:23.604 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:23.604 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.AioDiscardRequestsLock (36 ms) 2024-09-15T12:27:23.604 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.CancelAsyncResize 2024-09-15T12:27:23.643 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:503: Skipped 2024-09-15T12:27:23.644 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:23.644 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.CancelAsyncResize (39 ms) 2024-09-15T12:27:23.644 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.MultipleResize 2024-09-15T12:27:24.063 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestInternal.MultipleResize (420 ms) 2024-09-15T12:27:24.063 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.Metadata 2024-09-15T12:27:24.100 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:592: Skipped 2024-09-15T12:27:24.100 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:24.100 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.Metadata (37 ms) 2024-09-15T12:27:24.100 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.MetadataConfApply 2024-09-15T12:27:24.136 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:639: Skipped 2024-09-15T12:27:24.136 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:24.136 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.MetadataConfApply (36 ms) 2024-09-15T12:27:24.136 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.SnapshotCopyup 2024-09-15T12:27:24.172 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:662: Skipped 2024-09-15T12:27:24.172 INFO:tasks.workunit.client.0.smithi092.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:24.172 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup (36 ms) 2024-09-15T12:27:24.172 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.SnapshotCopyupZeros 2024-09-15T12:27:24.208 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:814: Skipped 2024-09-15T12:27:24.208 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:24.208 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZeros (36 ms) 2024-09-15T12:27:24.208 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.SnapshotCopyupZerosMigration 2024-09-15T12:27:24.244 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:902: Skipped 2024-09-15T12:27:24.244 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:24.244 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZerosMigration (36 ms) 2024-09-15T12:27:24.244 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.ResizeCopyup 2024-09-15T12:27:24.281 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:987: Skipped 2024-09-15T12:27:24.281 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:24.281 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.ResizeCopyup (37 ms) 2024-09-15T12:27:24.281 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.DiscardCopyup 2024-09-15T12:27:24.318 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1052: Skipped 2024-09-15T12:27:24.318 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:24.318 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.DiscardCopyup (37 ms) 2024-09-15T12:27:24.318 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.ImageOptions 2024-09-15T12:27:24.356 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestInternal.ImageOptions (38 ms) 2024-09-15T12:27:24.356 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.WriteFullCopyup 2024-09-15T12:27:24.392 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1183: Skipped 2024-09-15T12:27:24.393 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:24.393 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.WriteFullCopyup (36 ms) 2024-09-15T12:27:24.393 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.DiffIterateCloneOverwrite 2024-09-15T12:27:24.429 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1257: Skipped 2024-09-15T12:27:24.429 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:24.429 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.DiffIterateCloneOverwrite (36 ms) 2024-09-15T12:27:24.429 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.TestCoR 2024-09-15T12:27:24.468 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1307: Skipped 2024-09-15T12:27:24.468 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:24.468 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.TestCoR (39 ms) 2024-09-15T12:27:24.468 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.FlattenNoEmptyObjects 2024-09-15T12:27:24.503 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1455: Skipped 2024-09-15T12:27:24.504 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:24.504 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.FlattenNoEmptyObjects (36 ms) 2024-09-15T12:27:24.504 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.PoolMetadataConfApply 2024-09-15T12:27:24.540 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1574: Skipped 2024-09-15T12:27:24.540 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:24.540 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.PoolMetadataConfApply (36 ms) 2024-09-15T12:27:24.540 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.Sparsify 2024-09-15T12:27:24.698 INFO:tasks.workunit.client.0.smithi092.stdout:sparsify_supported=1 2024-09-15T12:27:24.698 INFO:tasks.workunit.client.0.smithi092.stdout:sparse_read_supported=1 2024-09-15T12:27:24.923 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestInternal.Sparsify (383 ms) 2024-09-15T12:27:24.924 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.SparsifyClone 2024-09-15T12:27:24.960 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1737: Skipped 2024-09-15T12:27:24.961 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:24.961 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SparsifyClone (38 ms) 2024-09-15T12:27:24.961 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestInternal.MissingDataPool 2024-09-15T12:27:24.997 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1800: Skipped 2024-09-15T12:27:24.997 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:24.997 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.MissingDataPool (36 ms) 2024-09-15T12:27:25.881 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 34 tests from TestInternal (4215 ms total) 2024-09-15T12:27:25.882 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:27:25.882 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:25.882 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 34 tests from 1 test suite ran. (6928 ms total) 2024-09-15T12:27:25.882 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 4 tests. 2024-09-15T12:27:25.882 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 30 tests, listed below: 2024-09-15T12:27:25.882 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.OpenByID 2024-09-15T12:27:25.882 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.IsExclusiveLockOwner 2024-09-15T12:27:25.882 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.ResizeLocksImage 2024-09-15T12:27:25.882 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.ResizeFailsToLockImage 2024-09-15T12:27:25.882 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapCreateLocksImage 2024-09-15T12:27:25.883 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapCreateFailsToLockImage 2024-09-15T12:27:25.883 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapRollbackLocksImage 2024-09-15T12:27:25.883 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapRollbackFailsToLockImage 2024-09-15T12:27:25.883 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapSetReleasesLock 2024-09-15T12:27:25.883 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.FlattenLocksImage 2024-09-15T12:27:25.883 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.FlattenFailsToLockImage 2024-09-15T12:27:25.883 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-15T12:27:25.883 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-15T12:27:25.883 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.AioWriteRequestsLock 2024-09-15T12:27:25.883 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.AioDiscardRequestsLock 2024-09-15T12:27:25.883 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.CancelAsyncResize 2024-09-15T12:27:25.884 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.Metadata 2024-09-15T12:27:25.884 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.MetadataConfApply 2024-09-15T12:27:25.884 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup 2024-09-15T12:27:25.884 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZeros 2024-09-15T12:27:25.884 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZerosMigration 2024-09-15T12:27:25.884 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.ResizeCopyup 2024-09-15T12:27:25.884 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.DiscardCopyup 2024-09-15T12:27:25.884 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.WriteFullCopyup 2024-09-15T12:27:25.884 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.DiffIterateCloneOverwrite 2024-09-15T12:27:25.884 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.TestCoR 2024-09-15T12:27:25.884 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.FlattenNoEmptyObjects 2024-09-15T12:27:25.884 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.PoolMetadataConfApply 2024-09-15T12:27:25.885 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.SparsifyClone 2024-09-15T12:27:25.885 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestInternal.MissingDataPool 2024-09-15T12:27:25.971 INFO:tasks.workunit.client.0.smithi092.stdout:seed 33614 2024-09-15T12:27:25.971 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = TestMirroring.* 2024-09-15T12:27:25.972 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 51 tests from 1 test suite. 2024-09-15T12:27:25.972 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:25.972 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 51 tests from TestMirroring 2024-09-15T12:27:27.895 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage 2024-09-15T12:27:31.136 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage (3241 ms) 2024-09-15T12:27:31.136 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool 2024-09-15T12:27:32.475 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool (1339 ms) 2024-09-15T12:27:32.476 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled 2024-09-15T12:27:33.489 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled (1013 ms) 2024-09-15T12:27:33.489 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage 2024-09-15T12:27:34.819 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage (1330 ms) 2024-09-15T12:27:34.819 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap 2024-09-15T12:27:35.990 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap (1172 ms) 2024-09-15T12:27:35.991 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModePool 2024-09-15T12:27:37.255 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModePool (1264 ms) 2024-09-15T12:27:37.255 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled 2024-09-15T12:27:38.661 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled (1405 ms) 2024-09-15T12:27:38.661 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.DisableImageMirrorWithPeer 2024-09-15T12:27:38.661 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:482: Skipped 2024-09-15T12:27:38.661 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:38.661 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer (0 ms) 2024-09-15T12:27:38.661 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.DisableJournalingWithPeer 2024-09-15T12:27:38.662 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:520: Skipped 2024-09-15T12:27:38.662 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:38.662 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer (0 ms) 2024-09-15T12:27:38.662 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling 2024-09-15T12:27:39.535 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling (875 ms) 2024-09-15T12:27:39.535 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling 2024-09-15T12:27:40.490 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling (955 ms) 2024-09-15T12:27:40.490 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling 2024-09-15T12:27:42.373 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling (1883 ms) 2024-09-15T12:27:42.373 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock 2024-09-15T12:27:44.347 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock (1975 ms) 2024-09-15T12:27:44.348 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeDisabled 2024-09-15T12:27:45.451 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeDisabled (1104 ms) 2024-09-15T12:27:45.452 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage 2024-09-15T12:27:46.597 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage (1145 ms) 2024-09-15T12:27:46.597 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool 2024-09-15T12:27:47.911 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool (1314 ms) 2024-09-15T12:27:47.911 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling 2024-09-15T12:27:48.951 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling (1041 ms) 2024-09-15T12:27:48.952 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling 2024-09-15T12:27:49.921 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling (970 ms) 2024-09-15T12:27:49.922 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeDisabled 2024-09-15T12:27:51.183 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeDisabled (1261 ms) 2024-09-15T12:27:51.183 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage 2024-09-15T12:27:52.469 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage (1286 ms) 2024-09-15T12:27:52.469 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled 2024-09-15T12:27:54.558 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled (2089 ms) 2024-09-15T12:27:54.558 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModePool 2024-09-15T12:27:55.985 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModePool (1428 ms) 2024-09-15T12:27:55.986 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModePool 2024-09-15T12:27:57.320 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModePool (1334 ms) 2024-09-15T12:27:57.320 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModeImage 2024-09-15T12:27:58.610 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModeImage (1290 ms) 2024-09-15T12:27:58.611 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode 2024-09-15T12:28:00.568 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode (1958 ms) 2024-09-15T12:28:00.568 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode 2024-09-15T12:28:02.571 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode (2003 ms) 2024-09-15T12:28:02.571 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode 2024-09-15T12:28:04.295 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode (1724 ms) 2024-09-15T12:28:04.295 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode 2024-09-15T12:28:06.107 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode (1812 ms) 2024-09-15T12:28:06.107 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode 2024-09-15T12:28:08.014 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode (1907 ms) 2024-09-15T12:28:08.014 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode 2024-09-15T12:28:10.180 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode (2166 ms) 2024-09-15T12:28:10.180 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageEnabled 2024-09-15T12:28:11.228 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageEnabled (1048 ms) 2024-09-15T12:28:11.228 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDisabled 2024-09-15T12:28:12.193 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDisabled (965 ms) 2024-09-15T12:28:12.193 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.RemoveImage_With_ImageWithoutJournal 2024-09-15T12:28:13.008 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.RemoveImage_With_ImageWithoutJournal (815 ms) 2024-09-15T12:28:13.008 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDemoted 2024-09-15T12:28:14.694 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDemoted (1686 ms) 2024-09-15T12:28:14.694 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.TrashMoveRestore_PoolMode 2024-09-15T12:28:16.323 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.TrashMoveRestore_PoolMode (1629 ms) 2024-09-15T12:28:16.324 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled 2024-09-15T12:28:17.695 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled (1372 ms) 2024-09-15T12:28:17.695 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled 2024-09-15T12:28:19.094 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled (1399 ms) 2024-09-15T12:28:19.094 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.MirrorStatusList 2024-09-15T12:28:20.030 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.MirrorStatusList (936 ms) 2024-09-15T12:28:20.030 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.RemoveBootstrapped 2024-09-15T12:28:21.230 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.RemoveBootstrapped (1200 ms) 2024-09-15T12:28:21.230 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.AioPromoteDemote 2024-09-15T12:28:27.305 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.AioPromoteDemote (6075 ms) 2024-09-15T12:28:27.305 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.AioGetInfo 2024-09-15T12:28:31.687 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.AioGetInfo (4382 ms) 2024-09-15T12:28:31.687 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.AioGetStatus 2024-09-15T12:28:34.507 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.AioGetStatus (2820 ms) 2024-09-15T12:28:34.507 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.SiteName 2024-09-15T12:28:34.513 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.SiteName (6 ms) 2024-09-15T12:28:34.513 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.Bootstrap 2024-09-15T12:28:46.165 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.Bootstrap (11653 ms) 2024-09-15T12:28:46.166 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.PeerDirection 2024-09-15T12:28:46.239 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroring.PeerDirection (72 ms) 2024-09-15T12:28:46.239 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.Snapshot 2024-09-15T12:28:46.239 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1109: Skipped 2024-09-15T12:28:46.239 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:46.239 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.Snapshot (0 ms) 2024-09-15T12:28:46.239 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.SnapshotRemoveOnDisable 2024-09-15T12:28:46.239 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1188: Skipped 2024-09-15T12:28:46.239 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:46.239 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.SnapshotRemoveOnDisable (0 ms) 2024-09-15T12:28:46.239 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.SnapshotUnlinkPeer 2024-09-15T12:28:46.240 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1226: Skipped 2024-09-15T12:28:46.240 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:46.240 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.SnapshotUnlinkPeer (0 ms) 2024-09-15T12:28:46.240 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.SnapshotImageState 2024-09-15T12:28:46.240 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1339: Skipped 2024-09-15T12:28:46.240 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:46.240 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.SnapshotImageState (0 ms) 2024-09-15T12:28:46.240 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.SnapshotPromoteDemote 2024-09-15T12:28:46.240 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1449: Skipped 2024-09-15T12:28:46.240 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:46.240 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.SnapshotPromoteDemote (0 ms) 2024-09-15T12:28:46.240 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroring.AioSnapshotCreate 2024-09-15T12:28:46.240 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1484: Skipped 2024-09-15T12:28:46.241 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:46.241 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.AioSnapshotCreate (0 ms) 2024-09-15T12:28:47.229 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 51 tests from TestMirroring (78343 ms total) 2024-09-15T12:28:47.229 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:28:47.229 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:28:47.230 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 51 tests from 1 test suite ran. (81258 ms total) 2024-09-15T12:28:47.230 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 43 tests. 2024-09-15T12:28:47.230 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-15T12:28:47.230 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer 2024-09-15T12:28:47.230 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer 2024-09-15T12:28:47.230 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.Snapshot 2024-09-15T12:28:47.230 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.SnapshotRemoveOnDisable 2024-09-15T12:28:47.230 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.SnapshotUnlinkPeer 2024-09-15T12:28:47.230 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.SnapshotImageState 2024-09-15T12:28:47.230 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.SnapshotPromoteDemote 2024-09-15T12:28:47.230 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestMirroring.AioSnapshotCreate 2024-09-15T12:28:47.351 INFO:tasks.workunit.client.0.smithi092.stdout:seed 34118 2024-09-15T12:28:47.351 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = TestGroup.* 2024-09-15T12:28:47.351 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-15T12:28:47.352 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:28:47.352 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 13 tests from TestGroup 2024-09-15T12:28:49.230 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestGroup.group_create 2024-09-15T12:28:51.407 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestGroup.group_create (2177 ms) 2024-09-15T12:28:51.407 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestGroup.group_createPP 2024-09-15T12:28:51.551 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestGroup.group_createPP (144 ms) 2024-09-15T12:28:51.551 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestGroup.group_get_id 2024-09-15T12:28:51.662 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestGroup.group_get_id (112 ms) 2024-09-15T12:28:51.662 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestGroup.group_get_idPP 2024-09-15T12:28:51.773 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestGroup.group_get_idPP (110 ms) 2024-09-15T12:28:51.773 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestGroup.add_image 2024-09-15T12:28:51.809 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:113: Skipped 2024-09-15T12:28:51.809 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:51.809 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.add_image (37 ms) 2024-09-15T12:28:51.810 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestGroup.add_imagePP 2024-09-15T12:28:51.845 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:195: Skipped 2024-09-15T12:28:51.845 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:51.845 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.add_imagePP (35 ms) 2024-09-15T12:28:51.845 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestGroup.add_snapshot 2024-09-15T12:28:51.881 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:260: Skipped 2024-09-15T12:28:51.881 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:51.881 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.add_snapshot (36 ms) 2024-09-15T12:28:51.881 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestGroup.add_snapshotPP 2024-09-15T12:28:51.916 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:413: Skipped 2024-09-15T12:28:51.916 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:51.916 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.add_snapshotPP (35 ms) 2024-09-15T12:28:51.916 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestGroup.snap_get_info 2024-09-15T12:28:51.958 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:498: Skipped 2024-09-15T12:28:51.959 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:51.959 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.snap_get_info (43 ms) 2024-09-15T12:28:51.959 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestGroup.snap_get_infoPP 2024-09-15T12:28:51.996 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:553: Skipped 2024-09-15T12:28:51.996 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:51.996 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.snap_get_infoPP (37 ms) 2024-09-15T12:28:51.996 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestGroup.snap_list2 2024-09-15T12:28:52.032 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:601: Skipped 2024-09-15T12:28:52.033 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:52.033 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.snap_list2 (36 ms) 2024-09-15T12:28:52.033 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestGroup.snap_list2PP 2024-09-15T12:28:52.068 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:700: Skipped 2024-09-15T12:28:52.068 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:52.068 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.snap_list2PP (36 ms) 2024-09-15T12:28:52.068 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestGroup.snap_list_internal 2024-09-15T12:28:52.103 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:781: Skipped 2024-09-15T12:28:52.103 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:52.103 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.snap_list_internal (35 ms) 2024-09-15T12:28:52.244 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 13 tests from TestGroup (2873 ms total) 2024-09-15T12:28:52.244 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:28:52.244 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:28:52.244 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 13 tests from 1 test suite ran. (4893 ms total) 2024-09-15T12:28:52.244 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 4 tests. 2024-09-15T12:28:52.244 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 9 tests, listed below: 2024-09-15T12:28:52.244 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.add_image 2024-09-15T12:28:52.244 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.add_imagePP 2024-09-15T12:28:52.244 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.add_snapshot 2024-09-15T12:28:52.244 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.add_snapshotPP 2024-09-15T12:28:52.244 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.snap_get_info 2024-09-15T12:28:52.244 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.snap_get_infoPP 2024-09-15T12:28:52.244 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.snap_list2 2024-09-15T12:28:52.245 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.snap_list2PP 2024-09-15T12:28:52.245 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestGroup.snap_list_internal 2024-09-15T12:28:52.331 INFO:tasks.workunit.client.0.smithi092.stdout:seed 34167 2024-09-15T12:28:52.332 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = TestMirroringWatcher.* 2024-09-15T12:28:52.332 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-15T12:28:52.332 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:28:52.332 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 2 tests from TestMirroringWatcher 2024-09-15T12:28:54.252 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroringWatcher.ModeUpdated 2024-09-15T12:28:55.950 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroringWatcher.ModeUpdated (1698 ms) 2024-09-15T12:28:55.950 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestMirroringWatcher.ImageStatusUpdated 2024-09-15T12:28:56.064 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestMirroringWatcher.ImageStatusUpdated (115 ms) 2024-09-15T12:28:56.798 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 2 tests from TestMirroringWatcher (1813 ms total) 2024-09-15T12:28:56.798 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:28:56.798 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:28:56.798 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 2 tests from 1 test suite ran. (4466 ms total) 2024-09-15T12:28:56.798 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 2 tests. 2024-09-15T12:28:56.895 INFO:tasks.workunit.client.0.smithi092.stdout:seed 34219 2024-09-15T12:28:56.897 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = TestObjectMap.* 2024-09-15T12:28:56.897 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-15T12:28:56.897 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:28:56.897 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 4 tests from TestObjectMap 2024-09-15T12:28:58.803 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-09-15T12:29:00.901 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:38: Skipped 2024-09-15T12:29:00.901 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:00.901 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenCorrupt (2098 ms) 2024-09-15T12:29:00.901 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-09-15T12:29:00.938 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:66: Skipped 2024-09-15T12:29:00.939 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:00.939 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenTooSmall (38 ms) 2024-09-15T12:29:00.939 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestObjectMap.InvalidateFlagOnDisk 2024-09-15T12:29:00.977 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:95: Skipped 2024-09-15T12:29:00.977 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:00.977 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestObjectMap.InvalidateFlagOnDisk (38 ms) 2024-09-15T12:29:00.977 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-09-15T12:29:01.014 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:128: Skipped 2024-09-15T12:29:01.014 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:01.014 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall (37 ms) 2024-09-15T12:29:01.815 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 4 tests from TestObjectMap (2211 ms total) 2024-09-15T12:29:01.815 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:29:01.815 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:29:01.815 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 4 tests from 1 test suite ran. (4918 ms total) 2024-09-15T12:29:01.815 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 0 tests. 2024-09-15T12:29:01.815 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-15T12:29:01.815 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-09-15T12:29:01.815 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-09-15T12:29:01.815 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestObjectMap.InvalidateFlagOnDisk 2024-09-15T12:29:01.815 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-09-15T12:29:01.815 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:29:01.815 INFO:tasks.workunit.client.0.smithi092.stdout: YOU HAVE 1 DISABLED TEST 2024-09-15T12:29:01.816 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:29:01.921 INFO:tasks.workunit.client.0.smithi092.stdout:seed 34268 2024-09-15T12:29:01.921 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = TestOperations.* 2024-09-15T12:29:01.921 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 1 test from 1 test suite. 2024-09-15T12:29:01.921 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:29:01.921 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 1 test from TestOperations 2024-09-15T12:29:03.825 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestOperations.DisableJournalingCorrupt 2024-09-15T12:29:05.877 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Operations.cc:18: Skipped 2024-09-15T12:29:05.878 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:05.878 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt (2052 ms) 2024-09-15T12:29:06.840 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 1 test from TestOperations (2052 ms total) 2024-09-15T12:29:06.840 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:29:06.840 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:29:06.840 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 1 test from 1 test suite ran. (4919 ms total) 2024-09-15T12:29:06.840 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 0 tests. 2024-09-15T12:29:06.840 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-15T12:29:06.840 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt 2024-09-15T12:29:06.937 INFO:tasks.workunit.client.0.smithi092.stdout:seed 34317 2024-09-15T12:29:06.937 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = TestTrash.* 2024-09-15T12:29:06.937 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-15T12:29:06.937 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:29:06.937 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 2 tests from TestTrash 2024-09-15T12:29:08.839 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestTrash.UserRemovingSource 2024-09-15T12:29:10.925 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Trash.cc:36: Skipped 2024-09-15T12:29:10.925 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:10.926 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestTrash.UserRemovingSource (2086 ms) 2024-09-15T12:29:10.926 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestTrash.RestoreMirroringSource 2024-09-15T12:29:10.960 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Trash.cc:93: Skipped 2024-09-15T12:29:10.961 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:10.961 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestTrash.RestoreMirroringSource (35 ms) 2024-09-15T12:29:11.863 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 2 tests from TestTrash (2121 ms total) 2024-09-15T12:29:11.863 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:29:11.863 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:29:11.864 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 2 tests from 1 test suite ran. (4926 ms total) 2024-09-15T12:29:11.864 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 0 tests. 2024-09-15T12:29:11.864 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-15T12:29:11.864 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestTrash.UserRemovingSource 2024-09-15T12:29:11.864 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestTrash.RestoreMirroringSource 2024-09-15T12:29:11.953 INFO:tasks.workunit.client.0.smithi092.stdout:seed 34366 2024-09-15T12:29:11.954 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = TestJournalEntries.* 2024-09-15T12:29:11.954 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-15T12:29:11.954 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:29:11.954 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 4 tests from TestJournalEntries 2024-09-15T12:29:13.869 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalEntries.AioWrite 2024-09-15T12:29:15.870 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:118: Skipped 2024-09-15T12:29:15.870 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:15.870 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalEntries.AioWrite (2001 ms) 2024-09-15T12:29:15.870 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalEntries.AioDiscard 2024-09-15T12:29:15.904 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:163: Skipped 2024-09-15T12:29:15.904 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:15.904 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard (34 ms) 2024-09-15T12:29:15.904 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalEntries.AioDiscardWithPrune 2024-09-15T12:29:15.942 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:200: Skipped 2024-09-15T12:29:15.942 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:15.942 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune (39 ms) 2024-09-15T12:29:15.943 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalEntries.AioFlush 2024-09-15T12:29:15.975 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:263: Skipped 2024-09-15T12:29:15.976 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:15.976 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalEntries.AioFlush (33 ms) 2024-09-15T12:29:16.885 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 4 tests from TestJournalEntries (2107 ms total) 2024-09-15T12:29:16.886 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:29:16.886 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:29:16.886 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 4 tests from 1 test suite ran. (4931 ms total) 2024-09-15T12:29:16.886 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 0 tests. 2024-09-15T12:29:16.886 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-15T12:29:16.886 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalEntries.AioWrite 2024-09-15T12:29:16.886 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard 2024-09-15T12:29:16.886 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune 2024-09-15T12:29:16.886 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalEntries.AioFlush 2024-09-15T12:29:16.985 INFO:tasks.workunit.client.0.smithi092.stdout:seed 34415 2024-09-15T12:29:16.985 INFO:tasks.workunit.client.0.smithi092.stdout:Note: Google Test filter = TestJournalReplay.* 2024-09-15T12:29:16.985 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 16 tests from 1 test suite. 2024-09-15T12:29:16.985 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2024-09-15T12:29:16.986 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 16 tests from TestJournalReplay 2024-09-15T12:29:18.893 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.AioDiscardEvent 2024-09-15T12:29:20.970 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:109: Skipped 2024-09-15T12:29:20.970 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:20.970 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent (2077 ms) 2024-09-15T12:29:20.970 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.AioWriteEvent 2024-09-15T12:29:21.006 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:200: Skipped 2024-09-15T12:29:21.006 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:21.006 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent (36 ms) 2024-09-15T12:29:21.006 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.AioFlushEvent 2024-09-15T12:29:21.042 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:261: Skipped 2024-09-15T12:29:21.042 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:21.042 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent (36 ms) 2024-09-15T12:29:21.042 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.SnapCreate 2024-09-15T12:29:21.081 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:307: Skipped 2024-09-15T12:29:21.081 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:21.081 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate (39 ms) 2024-09-15T12:29:21.081 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.SnapProtect 2024-09-15T12:29:21.118 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:348: Skipped 2024-09-15T12:29:21.118 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:21.119 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect (37 ms) 2024-09-15T12:29:21.119 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.SnapUnprotect 2024-09-15T12:29:21.163 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:394: Skipped 2024-09-15T12:29:21.163 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:21.164 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect (45 ms) 2024-09-15T12:29:21.164 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.SnapRename 2024-09-15T12:29:21.199 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:450: Skipped 2024-09-15T12:29:21.199 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:21.199 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.SnapRename (35 ms) 2024-09-15T12:29:21.199 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.SnapRollback 2024-09-15T12:29:21.235 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:500: Skipped 2024-09-15T12:29:21.236 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:21.236 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback (37 ms) 2024-09-15T12:29:21.236 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.SnapRemove 2024-09-15T12:29:21.272 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:541: Skipped 2024-09-15T12:29:21.272 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:21.272 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove (36 ms) 2024-09-15T12:29:21.272 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.Rename 2024-09-15T12:29:21.309 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:590: Skipped 2024-09-15T12:29:21.309 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:21.309 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.Rename (37 ms) 2024-09-15T12:29:21.309 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.Resize 2024-09-15T12:29:21.346 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:624: Skipped 2024-09-15T12:29:21.346 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:21.347 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.Resize (38 ms) 2024-09-15T12:29:21.347 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.Flatten 2024-09-15T12:29:21.385 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:657: Skipped 2024-09-15T12:29:21.385 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:21.385 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.Flatten (38 ms) 2024-09-15T12:29:21.385 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.UpdateFeatures 2024-09-15T12:29:21.422 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:704: Skipped 2024-09-15T12:29:21.422 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:21.422 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures (37 ms) 2024-09-15T12:29:21.422 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.MetadataSet 2024-09-15T12:29:21.458 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:741: Skipped 2024-09-15T12:29:21.458 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:21.458 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet (36 ms) 2024-09-15T12:29:21.458 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.MetadataRemove 2024-09-15T12:29:21.496 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:781: Skipped 2024-09-15T12:29:21.496 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:21.497 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove (39 ms) 2024-09-15T12:29:21.497 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestJournalReplay.ObjectPosition 2024-09-15T12:29:21.547 INFO:tasks.workunit.client.0.smithi092.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:824: Skipped 2024-09-15T12:29:21.547 INFO:tasks.workunit.client.0.smithi092.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:21.547 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition (50 ms) 2024-09-15T12:29:21.906 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 16 tests from TestJournalReplay (2654 ms total) 2024-09-15T12:29:21.906 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-15T12:29:21.906 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2024-09-15T12:29:21.906 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 16 tests from 1 test suite ran. (4921 ms total) 2024-09-15T12:29:21.906 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 0 tests. 2024-09-15T12:29:21.906 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-15T12:29:21.906 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent 2024-09-15T12:29:21.906 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent 2024-09-15T12:29:21.906 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent 2024-09-15T12:29:21.907 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate 2024-09-15T12:29:21.907 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect 2024-09-15T12:29:21.907 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect 2024-09-15T12:29:21.907 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.SnapRename 2024-09-15T12:29:21.907 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback 2024-09-15T12:29:21.907 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove 2024-09-15T12:29:21.907 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.Rename 2024-09-15T12:29:21.907 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.Resize 2024-09-15T12:29:21.907 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.Flatten 2024-09-15T12:29:21.907 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures 2024-09-15T12:29:21.907 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet 2024-09-15T12:29:21.907 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove 2024-09-15T12:29:21.908 INFO:tasks.workunit.client.0.smithi092.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition 2024-09-15T12:29:21.913 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-15T12:29:21.913 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-15T12:29:21.944 INFO:tasks.workunit:Stopping ['rbd/crimson/test_crimson_librbd.sh'] on client.0... 2024-09-15T12:29:21.944 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-15T12:29:22.357 DEBUG:teuthology.parallel:result is None 2024-09-15T12:29:22.357 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T12:29:22.385 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T12:29:22.385 DEBUG:teuthology.orchestra.run.smithi092:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-15T12:29:22.458 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T12:29:22.458 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-15T12:29:22.470 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T12:29:22.470 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:29:22.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:22.601+0000 7f1ceb688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:22.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:22.609+0000 7f1ceb688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:22.798 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:29:22.798 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-15T12:29:22.812 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":555,"stamp":"2024-09-15T12:29:22.685833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":84592,"kb_used_data":4096,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283030928,"statfs":{"total":289910292480,"available":289823670272,"internally_reserved":0,"allocated":4194304,"data_stored":2885188,"data_compressed":60094,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001020"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.912270+0000","last_change":"2024-09-15T12:17:30.855365+0000","last_active":"2024-09-15T12:29:19.912270+0000","last_peered":"2024-09-15T12:29:19.912270+0000","last_clean":"2024-09-15T12:29:19.912270+0000","last_became_active":"2024-09-15T12:17:28.924258+0000","last_became_peered":"2024-09-15T12:17:28.924258+0000","last_unstale":"2024-09-15T12:29:19.912270+0000","last_undegraded":"2024-09-15T12:29:19.912270+0000","last_fullsized":"2024-09-15T12:29:19.912270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.923397+0000","last_change":"2024-09-15T12:17:30.859678+0000","last_active":"2024-09-15T12:29:19.923397+0000","last_peered":"2024-09-15T12:29:19.923397+0000","last_clean":"2024-09-15T12:29:19.923397+0000","last_became_active":"2024-09-15T12:17:28.953744+0000","last_became_peered":"2024-09-15T12:17:28.953744+0000","last_unstale":"2024-09-15T12:29:19.923397+0000","last_undegraded":"2024-09-15T12:29:19.923397+0000","last_fullsized":"2024-09-15T12:29:19.923397+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.914232+0000","last_change":"2024-09-15T12:17:30.855158+0000","last_active":"2024-09-15T12:29:19.914232+0000","last_peered":"2024-09-15T12:29:19.914232+0000","last_clean":"2024-09-15T12:29:19.914232+0000","last_became_active":"2024-09-15T12:17:28.934272+0000","last_became_peered":"2024-09-15T12:17:28.934272+0000","last_unstale":"2024-09-15T12:29:19.914232+0000","last_undegraded":"2024-09-15T12:29:19.914232+0000","last_fullsized":"2024-09-15T12:29:19.914232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.911125+0000","last_change":"2024-09-15T12:17:30.854853+0000","last_active":"2024-09-15T12:29:19.911125+0000","last_peered":"2024-09-15T12:29:19.911125+0000","last_clean":"2024-09-15T12:29:19.911125+0000","last_became_active":"2024-09-15T12:17:28.906861+0000","last_became_peered":"2024-09-15T12:17:28.906861+0000","last_unstale":"2024-09-15T12:29:19.911125+0000","last_undegraded":"2024-09-15T12:29:19.911125+0000","last_fullsized":"2024-09-15T12:29:19.911125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":575,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-15T12:29:20.922237+0000","last_change":"2024-09-15T12:17:30.855086+0000","last_active":"2024-09-15T12:29:20.922237+0000","last_peered":"2024-09-15T12:29:20.922237+0000","last_clean":"2024-09-15T12:29:20.922237+0000","last_became_active":"2024-09-15T12:17:28.912738+0000","last_became_peered":"2024-09-15T12:17:28.912738+0000","last_unstale":"2024-09-15T12:29:20.922237+0000","last_undegraded":"2024-09-15T12:29:20.922237+0000","last_fullsized":"2024-09-15T12:29:20.922237+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.909843+0000","last_change":"2024-09-15T12:17:30.853570+0000","last_active":"2024-09-15T12:29:19.909843+0000","last_peered":"2024-09-15T12:29:19.909843+0000","last_clean":"2024-09-15T12:29:19.909843+0000","last_became_active":"2024-09-15T12:17:28.942066+0000","last_became_peered":"2024-09-15T12:17:28.942066+0000","last_unstale":"2024-09-15T12:29:19.909843+0000","last_undegraded":"2024-09-15T12:29:19.909843+0000","last_fullsized":"2024-09-15T12:29:19.909843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.910161+0000","last_change":"2024-09-15T12:17:30.849969+0000","last_active":"2024-09-15T12:29:19.910161+0000","last_peered":"2024-09-15T12:29:19.910161+0000","last_clean":"2024-09-15T12:29:19.910161+0000","last_became_active":"2024-09-15T12:17:28.906828+0000","last_became_peered":"2024-09-15T12:17:28.906828+0000","last_unstale":"2024-09-15T12:29:19.910161+0000","last_undegraded":"2024-09-15T12:29:19.910161+0000","last_fullsized":"2024-09-15T12:29:19.910161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":571,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.924824+0000","last_change":"2024-09-15T12:17:30.859057+0000","last_active":"2024-09-15T12:29:19.924824+0000","last_peered":"2024-09-15T12:29:19.924824+0000","last_clean":"2024-09-15T12:29:19.924824+0000","last_became_active":"2024-09-15T12:17:28.912555+0000","last_became_peered":"2024-09-15T12:17:28.912555+0000","last_unstale":"2024-09-15T12:29:19.924824+0000","last_undegraded":"2024-09-15T12:29:19.924824+0000","last_fullsized":"2024-09-15T12:29:19.924824+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":645,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.905176+0000","last_change":"2024-09-15T12:17:22.585730+0000","last_active":"2024-09-15T12:29:19.905176+0000","last_peered":"2024-09-15T12:29:19.905176+0000","last_clean":"2024-09-15T12:29:19.905176+0000","last_became_active":"2024-09-15T12:17:22.575804+0000","last_became_peered":"2024-09-15T12:17:22.575804+0000","last_unstale":"2024-09-15T12:29:19.905176+0000","last_undegraded":"2024-09-15T12:29:19.905176+0000","last_fullsized":"2024-09-15T12:29:19.905176+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:21.533890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:21.533890+0000","last_clean_scrub_stamp":"2024-09-15T12:17:21.533890+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28152,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1351680,"data_stored":566866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28216,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1417216,"data_stored":1157253,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28224,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1425408,"data_stored":1161069,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:29:22.813 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:29:22.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:22.916+0000 7fbf3d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:22.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:22.923+0000 7fbf3d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:23.108 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:29:23.108 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-15T12:29:23.121 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":555,"stamp":"2024-09-15T12:29:22.685833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":84592,"kb_used_data":4096,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283030928,"statfs":{"total":289910292480,"available":289823670272,"internally_reserved":0,"allocated":4194304,"data_stored":2885188,"data_compressed":60094,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001020"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.912270+0000","last_change":"2024-09-15T12:17:30.855365+0000","last_active":"2024-09-15T12:29:19.912270+0000","last_peered":"2024-09-15T12:29:19.912270+0000","last_clean":"2024-09-15T12:29:19.912270+0000","last_became_active":"2024-09-15T12:17:28.924258+0000","last_became_peered":"2024-09-15T12:17:28.924258+0000","last_unstale":"2024-09-15T12:29:19.912270+0000","last_undegraded":"2024-09-15T12:29:19.912270+0000","last_fullsized":"2024-09-15T12:29:19.912270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.923397+0000","last_change":"2024-09-15T12:17:30.859678+0000","last_active":"2024-09-15T12:29:19.923397+0000","last_peered":"2024-09-15T12:29:19.923397+0000","last_clean":"2024-09-15T12:29:19.923397+0000","last_became_active":"2024-09-15T12:17:28.953744+0000","last_became_peered":"2024-09-15T12:17:28.953744+0000","last_unstale":"2024-09-15T12:29:19.923397+0000","last_undegraded":"2024-09-15T12:29:19.923397+0000","last_fullsized":"2024-09-15T12:29:19.923397+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.914232+0000","last_change":"2024-09-15T12:17:30.855158+0000","last_active":"2024-09-15T12:29:19.914232+0000","last_peered":"2024-09-15T12:29:19.914232+0000","last_clean":"2024-09-15T12:29:19.914232+0000","last_became_active":"2024-09-15T12:17:28.934272+0000","last_became_peered":"2024-09-15T12:17:28.934272+0000","last_unstale":"2024-09-15T12:29:19.914232+0000","last_undegraded":"2024-09-15T12:29:19.914232+0000","last_fullsized":"2024-09-15T12:29:19.914232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.911125+0000","last_change":"2024-09-15T12:17:30.854853+0000","last_active":"2024-09-15T12:29:19.911125+0000","last_peered":"2024-09-15T12:29:19.911125+0000","last_clean":"2024-09-15T12:29:19.911125+0000","last_became_active":"2024-09-15T12:17:28.906861+0000","last_became_peered":"2024-09-15T12:17:28.906861+0000","last_unstale":"2024-09-15T12:29:19.911125+0000","last_undegraded":"2024-09-15T12:29:19.911125+0000","last_fullsized":"2024-09-15T12:29:19.911125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":575,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-15T12:29:20.922237+0000","last_change":"2024-09-15T12:17:30.855086+0000","last_active":"2024-09-15T12:29:20.922237+0000","last_peered":"2024-09-15T12:29:20.922237+0000","last_clean":"2024-09-15T12:29:20.922237+0000","last_became_active":"2024-09-15T12:17:28.912738+0000","last_became_peered":"2024-09-15T12:17:28.912738+0000","last_unstale":"2024-09-15T12:29:20.922237+0000","last_undegraded":"2024-09-15T12:29:20.922237+0000","last_fullsized":"2024-09-15T12:29:20.922237+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.909843+0000","last_change":"2024-09-15T12:17:30.853570+0000","last_active":"2024-09-15T12:29:19.909843+0000","last_peered":"2024-09-15T12:29:19.909843+0000","last_clean":"2024-09-15T12:29:19.909843+0000","last_became_active":"2024-09-15T12:17:28.942066+0000","last_became_peered":"2024-09-15T12:17:28.942066+0000","last_unstale":"2024-09-15T12:29:19.909843+0000","last_undegraded":"2024-09-15T12:29:19.909843+0000","last_fullsized":"2024-09-15T12:29:19.909843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.910161+0000","last_change":"2024-09-15T12:17:30.849969+0000","last_active":"2024-09-15T12:29:19.910161+0000","last_peered":"2024-09-15T12:29:19.910161+0000","last_clean":"2024-09-15T12:29:19.910161+0000","last_became_active":"2024-09-15T12:17:28.906828+0000","last_became_peered":"2024-09-15T12:17:28.906828+0000","last_unstale":"2024-09-15T12:29:19.910161+0000","last_undegraded":"2024-09-15T12:29:19.910161+0000","last_fullsized":"2024-09-15T12:29:19.910161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":571,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.924824+0000","last_change":"2024-09-15T12:17:30.859057+0000","last_active":"2024-09-15T12:29:19.924824+0000","last_peered":"2024-09-15T12:29:19.924824+0000","last_clean":"2024-09-15T12:29:19.924824+0000","last_became_active":"2024-09-15T12:17:28.912555+0000","last_became_peered":"2024-09-15T12:17:28.912555+0000","last_unstale":"2024-09-15T12:29:19.924824+0000","last_undegraded":"2024-09-15T12:29:19.924824+0000","last_fullsized":"2024-09-15T12:29:19.924824+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":645,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.905176+0000","last_change":"2024-09-15T12:17:22.585730+0000","last_active":"2024-09-15T12:29:19.905176+0000","last_peered":"2024-09-15T12:29:19.905176+0000","last_clean":"2024-09-15T12:29:19.905176+0000","last_became_active":"2024-09-15T12:17:22.575804+0000","last_became_peered":"2024-09-15T12:17:22.575804+0000","last_unstale":"2024-09-15T12:29:19.905176+0000","last_undegraded":"2024-09-15T12:29:19.905176+0000","last_fullsized":"2024-09-15T12:29:19.905176+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:21.533890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:21.533890+0000","last_clean_scrub_stamp":"2024-09-15T12:17:21.533890+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28152,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1351680,"data_stored":566866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28216,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1417216,"data_stored":1157253,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28224,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1425408,"data_stored":1161069,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:29:23.122 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T12:29:23.122 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:29:23.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:23.225+0000 7f62fb751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:23.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:23.233+0000 7f62fb751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:23.421 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:29:23.421 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-15T12:29:23.434 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":555,"stamp":"2024-09-15T12:29:22.685833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":84592,"kb_used_data":4096,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283030928,"statfs":{"total":289910292480,"available":289823670272,"internally_reserved":0,"allocated":4194304,"data_stored":2885188,"data_compressed":60094,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001020"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.912270+0000","last_change":"2024-09-15T12:17:30.855365+0000","last_active":"2024-09-15T12:29:19.912270+0000","last_peered":"2024-09-15T12:29:19.912270+0000","last_clean":"2024-09-15T12:29:19.912270+0000","last_became_active":"2024-09-15T12:17:28.924258+0000","last_became_peered":"2024-09-15T12:17:28.924258+0000","last_unstale":"2024-09-15T12:29:19.912270+0000","last_undegraded":"2024-09-15T12:29:19.912270+0000","last_fullsized":"2024-09-15T12:29:19.912270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.923397+0000","last_change":"2024-09-15T12:17:30.859678+0000","last_active":"2024-09-15T12:29:19.923397+0000","last_peered":"2024-09-15T12:29:19.923397+0000","last_clean":"2024-09-15T12:29:19.923397+0000","last_became_active":"2024-09-15T12:17:28.953744+0000","last_became_peered":"2024-09-15T12:17:28.953744+0000","last_unstale":"2024-09-15T12:29:19.923397+0000","last_undegraded":"2024-09-15T12:29:19.923397+0000","last_fullsized":"2024-09-15T12:29:19.923397+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.914232+0000","last_change":"2024-09-15T12:17:30.855158+0000","last_active":"2024-09-15T12:29:19.914232+0000","last_peered":"2024-09-15T12:29:19.914232+0000","last_clean":"2024-09-15T12:29:19.914232+0000","last_became_active":"2024-09-15T12:17:28.934272+0000","last_became_peered":"2024-09-15T12:17:28.934272+0000","last_unstale":"2024-09-15T12:29:19.914232+0000","last_undegraded":"2024-09-15T12:29:19.914232+0000","last_fullsized":"2024-09-15T12:29:19.914232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.911125+0000","last_change":"2024-09-15T12:17:30.854853+0000","last_active":"2024-09-15T12:29:19.911125+0000","last_peered":"2024-09-15T12:29:19.911125+0000","last_clean":"2024-09-15T12:29:19.911125+0000","last_became_active":"2024-09-15T12:17:28.906861+0000","last_became_peered":"2024-09-15T12:17:28.906861+0000","last_unstale":"2024-09-15T12:29:19.911125+0000","last_undegraded":"2024-09-15T12:29:19.911125+0000","last_fullsized":"2024-09-15T12:29:19.911125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":575,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-15T12:29:20.922237+0000","last_change":"2024-09-15T12:17:30.855086+0000","last_active":"2024-09-15T12:29:20.922237+0000","last_peered":"2024-09-15T12:29:20.922237+0000","last_clean":"2024-09-15T12:29:20.922237+0000","last_became_active":"2024-09-15T12:17:28.912738+0000","last_became_peered":"2024-09-15T12:17:28.912738+0000","last_unstale":"2024-09-15T12:29:20.922237+0000","last_undegraded":"2024-09-15T12:29:20.922237+0000","last_fullsized":"2024-09-15T12:29:20.922237+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.909843+0000","last_change":"2024-09-15T12:17:30.853570+0000","last_active":"2024-09-15T12:29:19.909843+0000","last_peered":"2024-09-15T12:29:19.909843+0000","last_clean":"2024-09-15T12:29:19.909843+0000","last_became_active":"2024-09-15T12:17:28.942066+0000","last_became_peered":"2024-09-15T12:17:28.942066+0000","last_unstale":"2024-09-15T12:29:19.909843+0000","last_undegraded":"2024-09-15T12:29:19.909843+0000","last_fullsized":"2024-09-15T12:29:19.909843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.910161+0000","last_change":"2024-09-15T12:17:30.849969+0000","last_active":"2024-09-15T12:29:19.910161+0000","last_peered":"2024-09-15T12:29:19.910161+0000","last_clean":"2024-09-15T12:29:19.910161+0000","last_became_active":"2024-09-15T12:17:28.906828+0000","last_became_peered":"2024-09-15T12:17:28.906828+0000","last_unstale":"2024-09-15T12:29:19.910161+0000","last_undegraded":"2024-09-15T12:29:19.910161+0000","last_fullsized":"2024-09-15T12:29:19.910161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":571,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.924824+0000","last_change":"2024-09-15T12:17:30.859057+0000","last_active":"2024-09-15T12:29:19.924824+0000","last_peered":"2024-09-15T12:29:19.924824+0000","last_clean":"2024-09-15T12:29:19.924824+0000","last_became_active":"2024-09-15T12:17:28.912555+0000","last_became_peered":"2024-09-15T12:17:28.912555+0000","last_unstale":"2024-09-15T12:29:19.924824+0000","last_undegraded":"2024-09-15T12:29:19.924824+0000","last_fullsized":"2024-09-15T12:29:19.924824+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":645,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.905176+0000","last_change":"2024-09-15T12:17:22.585730+0000","last_active":"2024-09-15T12:29:19.905176+0000","last_peered":"2024-09-15T12:29:19.905176+0000","last_clean":"2024-09-15T12:29:19.905176+0000","last_became_active":"2024-09-15T12:17:22.575804+0000","last_became_peered":"2024-09-15T12:17:22.575804+0000","last_unstale":"2024-09-15T12:29:19.905176+0000","last_undegraded":"2024-09-15T12:29:19.905176+0000","last_fullsized":"2024-09-15T12:29:19.905176+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:21.533890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:21.533890+0000","last_clean_scrub_stamp":"2024-09-15T12:17:21.533890+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28152,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1351680,"data_stored":566866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28216,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1417216,"data_stored":1157253,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28224,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1425408,"data_stored":1161069,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:29:23.435 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:29:23.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:23.537+0000 7f3486391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:23.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:23.544+0000 7f3486391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:23.734 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:29:23.734 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":202,"fsid":"b40a72a8-68fe-4cd3-b94d-fb82d50c7882","created":"2024-09-15T12:17:10.700138+0000","modified":"2024-09-15T12:29:21.898806+0000","last_up_change":"2024-09-15T12:17:20.533134+0000","last_in_change":"2024-09-15T12:17:12.582420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:17:20.544251+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T12:17:27.071454+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2a0b963b-a469-4a12-beba-0602d3694624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6805","nonce":3819398539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":3819398539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":3819398539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3819398539}]},"public_addr":"172.21.15.92:6805/3819398539","cluster_addr":"172.21.15.92:6804/3819398539","heartbeat_back_addr":"172.21.15.92:6809/3819398539","heartbeat_front_addr":"172.21.15.92:6812/3819398539","state":["exists","up"]},{"osd":1,"uuid":"7bfbf59d-23c0-49e2-beb0-98fd526c5811","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6803","nonce":950917640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":950917640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":950917640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6811","nonce":950917640}]},"public_addr":"172.21.15.92:6803/950917640","cluster_addr":"172.21.15.92:6802/950917640","heartbeat_back_addr":"172.21.15.92:6810/950917640","heartbeat_front_addr":"172.21.15.92:6811/950917640","state":["exists","up"]},{"osd":2,"uuid":"8760d8ef-0dcb-4387-afbd-7d28a18cabce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2494303087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6807","nonce":2494303087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2494303087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":2494303087}]},"public_addr":"172.21.15.92:6806/2494303087","cluster_addr":"172.21.15.92:6807/2494303087","heartbeat_back_addr":"172.21.15.92:6814/2494303087","heartbeat_front_addr":"172.21.15.92:6813/2494303087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":3,"snaps":[{"begin":2,"length":13},{"begin":17,"length":1},{"begin":21,"length":1},{"begin":24,"length":1},{"begin":28,"length":8}]},{"pool":4,"snaps":[{"begin":2,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1}]},{"pool":6,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":2,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":1}]},{"pool":20,"snaps":[{"begin":2,"length":4}]},{"pool":21,"snaps":[{"begin":2,"length":1}]},{"pool":22,"snaps":[{"begin":2,"length":1}]},{"pool":23,"snaps":[{"begin":2,"length":1}]},{"pool":24,"snaps":[{"begin":2,"length":1}]},{"pool":25,"snaps":[{"begin":2,"length":1}]},{"pool":26,"snaps":[{"begin":2,"length":1}]},{"pool":27,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:29:24.749 INFO:tasks.ceph:Scrubbing osd.0 2024-09-15T12:29:24.749 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-15T12:29:24.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:24.859+0000 7f8d094d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:24.872+0000 7f8d094d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:24.887 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-15T12:29:24.887 INFO:teuthology.orchestra.run.smithi092.stdout: "success": "" 2024-09-15T12:29:24.887 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-15T12:29:24.899 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-15T12:29:25.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:25.001+0000 7f39cfd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:25.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:25.009+0000 7f39cfd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:25.198 INFO:teuthology.orchestra.run.smithi092.stderr:instructed osd(s) 0 to deep-scrub 2024-09-15T12:29:25.216 INFO:tasks.ceph:Scrubbing osd.1 2024-09-15T12:29:25.216 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-15T12:29:25.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:25.318+0000 7fde74abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:25.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:25.331+0000 7fde74abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:25.346 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-15T12:29:25.347 INFO:teuthology.orchestra.run.smithi092.stdout: "success": "" 2024-09-15T12:29:25.347 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-15T12:29:25.357 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-15T12:29:25.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:25.460+0000 7f8b68d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:25.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:25.469+0000 7f8b68d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:25.659 INFO:teuthology.orchestra.run.smithi092.stderr:instructed osd(s) 1 to deep-scrub 2024-09-15T12:29:25.678 INFO:tasks.ceph:Scrubbing osd.2 2024-09-15T12:29:25.678 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-15T12:29:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:25.784+0000 7efc59391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:25.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:25.800+0000 7efc59391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:25.818 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-15T12:29:25.818 INFO:teuthology.orchestra.run.smithi092.stdout: "success": "" 2024-09-15T12:29:25.818 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-15T12:29:25.830 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-15T12:29:25.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:25.933+0000 7fa1e7d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:25.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:25.942+0000 7fa1e7d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:26.133 INFO:teuthology.orchestra.run.smithi092.stderr:instructed osd(s) 2 to deep-scrub 2024-09-15T12:29:26.150 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:29:26.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:26.252+0000 7f14b1751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:26.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:26.259+0000 7f14b1751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:26.448 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:29:26.448 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-15T12:29:26.461 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":556,"stamp":"2024-09-15T12:29:24.686167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":84592,"kb_used_data":4096,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283030928,"statfs":{"total":289910292480,"available":289823670272,"internally_reserved":0,"allocated":4194304,"data_stored":2885188,"data_compressed":60094,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.796903"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.912270+0000","last_change":"2024-09-15T12:17:30.855365+0000","last_active":"2024-09-15T12:29:19.912270+0000","last_peered":"2024-09-15T12:29:19.912270+0000","last_clean":"2024-09-15T12:29:19.912270+0000","last_became_active":"2024-09-15T12:17:28.924258+0000","last_became_peered":"2024-09-15T12:17:28.924258+0000","last_unstale":"2024-09-15T12:29:19.912270+0000","last_undegraded":"2024-09-15T12:29:19.912270+0000","last_fullsized":"2024-09-15T12:29:19.912270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.923397+0000","last_change":"2024-09-15T12:17:30.859678+0000","last_active":"2024-09-15T12:29:19.923397+0000","last_peered":"2024-09-15T12:29:19.923397+0000","last_clean":"2024-09-15T12:29:19.923397+0000","last_became_active":"2024-09-15T12:17:28.953744+0000","last_became_peered":"2024-09-15T12:17:28.953744+0000","last_unstale":"2024-09-15T12:29:19.923397+0000","last_undegraded":"2024-09-15T12:29:19.923397+0000","last_fullsized":"2024-09-15T12:29:19.923397+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.914232+0000","last_change":"2024-09-15T12:17:30.855158+0000","last_active":"2024-09-15T12:29:19.914232+0000","last_peered":"2024-09-15T12:29:19.914232+0000","last_clean":"2024-09-15T12:29:19.914232+0000","last_became_active":"2024-09-15T12:17:28.934272+0000","last_became_peered":"2024-09-15T12:17:28.934272+0000","last_unstale":"2024-09-15T12:29:19.914232+0000","last_undegraded":"2024-09-15T12:29:19.914232+0000","last_fullsized":"2024-09-15T12:29:19.914232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.911125+0000","last_change":"2024-09-15T12:17:30.854853+0000","last_active":"2024-09-15T12:29:19.911125+0000","last_peered":"2024-09-15T12:29:19.911125+0000","last_clean":"2024-09-15T12:29:19.911125+0000","last_became_active":"2024-09-15T12:17:28.906861+0000","last_became_peered":"2024-09-15T12:17:28.906861+0000","last_unstale":"2024-09-15T12:29:19.911125+0000","last_undegraded":"2024-09-15T12:29:19.911125+0000","last_fullsized":"2024-09-15T12:29:19.911125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":575,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-15T12:29:20.922237+0000","last_change":"2024-09-15T12:17:30.855086+0000","last_active":"2024-09-15T12:29:20.922237+0000","last_peered":"2024-09-15T12:29:20.922237+0000","last_clean":"2024-09-15T12:29:20.922237+0000","last_became_active":"2024-09-15T12:17:28.912738+0000","last_became_peered":"2024-09-15T12:17:28.912738+0000","last_unstale":"2024-09-15T12:29:20.922237+0000","last_undegraded":"2024-09-15T12:29:20.922237+0000","last_fullsized":"2024-09-15T12:29:20.922237+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.909843+0000","last_change":"2024-09-15T12:17:30.853570+0000","last_active":"2024-09-15T12:29:19.909843+0000","last_peered":"2024-09-15T12:29:19.909843+0000","last_clean":"2024-09-15T12:29:19.909843+0000","last_became_active":"2024-09-15T12:17:28.942066+0000","last_became_peered":"2024-09-15T12:17:28.942066+0000","last_unstale":"2024-09-15T12:29:19.909843+0000","last_undegraded":"2024-09-15T12:29:19.909843+0000","last_fullsized":"2024-09-15T12:29:19.909843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.910161+0000","last_change":"2024-09-15T12:17:30.849969+0000","last_active":"2024-09-15T12:29:19.910161+0000","last_peered":"2024-09-15T12:29:19.910161+0000","last_clean":"2024-09-15T12:29:19.910161+0000","last_became_active":"2024-09-15T12:17:28.906828+0000","last_became_peered":"2024-09-15T12:17:28.906828+0000","last_unstale":"2024-09-15T12:29:19.910161+0000","last_undegraded":"2024-09-15T12:29:19.910161+0000","last_fullsized":"2024-09-15T12:29:19.910161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":571,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.924824+0000","last_change":"2024-09-15T12:17:30.859057+0000","last_active":"2024-09-15T12:29:19.924824+0000","last_peered":"2024-09-15T12:29:19.924824+0000","last_clean":"2024-09-15T12:29:19.924824+0000","last_became_active":"2024-09-15T12:17:28.912555+0000","last_became_peered":"2024-09-15T12:17:28.912555+0000","last_unstale":"2024-09-15T12:29:19.924824+0000","last_undegraded":"2024-09-15T12:29:19.924824+0000","last_fullsized":"2024-09-15T12:29:19.924824+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":645,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.905176+0000","last_change":"2024-09-15T12:17:22.585730+0000","last_active":"2024-09-15T12:29:19.905176+0000","last_peered":"2024-09-15T12:29:19.905176+0000","last_clean":"2024-09-15T12:29:19.905176+0000","last_became_active":"2024-09-15T12:17:22.575804+0000","last_became_peered":"2024-09-15T12:17:22.575804+0000","last_unstale":"2024-09-15T12:29:19.905176+0000","last_undegraded":"2024-09-15T12:29:19.905176+0000","last_fullsized":"2024-09-15T12:29:19.905176+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:21.533890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:21.533890+0000","last_clean_scrub_stamp":"2024-09-15T12:17:21.533890+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28152,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1351680,"data_stored":566866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28216,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1417216,"data_stored":1157253,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28224,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1425408,"data_stored":1161069,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:29:26.465 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:26.465 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:26.465 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:26.465 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:26.465 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:26.465 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:26.465 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:26.466 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:26.466 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-15T12:17:21.533890+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=21, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:26.466 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-15T12:29:46.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:29:46.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:46.585+0000 7fda73a84640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:46.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:29:46.592+0000 7fda73a84640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:46.785 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:29:46.785 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-15T12:29:46.798 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":567,"stamp":"2024-09-15T12:29:46.691198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":84592,"kb_used_data":4096,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283030928,"statfs":{"total":289910292480,"available":289823670272,"internally_reserved":0,"allocated":4194304,"data_stored":2885188,"data_compressed":60094,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002760"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.912270+0000","last_change":"2024-09-15T12:17:30.855365+0000","last_active":"2024-09-15T12:29:19.912270+0000","last_peered":"2024-09-15T12:29:19.912270+0000","last_clean":"2024-09-15T12:29:19.912270+0000","last_became_active":"2024-09-15T12:17:28.924258+0000","last_became_peered":"2024-09-15T12:17:28.924258+0000","last_unstale":"2024-09-15T12:29:19.912270+0000","last_undegraded":"2024-09-15T12:29:19.912270+0000","last_fullsized":"2024-09-15T12:29:19.912270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.923397+0000","last_change":"2024-09-15T12:17:30.859678+0000","last_active":"2024-09-15T12:29:19.923397+0000","last_peered":"2024-09-15T12:29:19.923397+0000","last_clean":"2024-09-15T12:29:19.923397+0000","last_became_active":"2024-09-15T12:17:28.953744+0000","last_became_peered":"2024-09-15T12:17:28.953744+0000","last_unstale":"2024-09-15T12:29:19.923397+0000","last_undegraded":"2024-09-15T12:29:19.923397+0000","last_fullsized":"2024-09-15T12:29:19.923397+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.914232+0000","last_change":"2024-09-15T12:17:30.855158+0000","last_active":"2024-09-15T12:29:19.914232+0000","last_peered":"2024-09-15T12:29:19.914232+0000","last_clean":"2024-09-15T12:29:19.914232+0000","last_became_active":"2024-09-15T12:17:28.934272+0000","last_became_peered":"2024-09-15T12:17:28.934272+0000","last_unstale":"2024-09-15T12:29:19.914232+0000","last_undegraded":"2024-09-15T12:29:19.914232+0000","last_fullsized":"2024-09-15T12:29:19.914232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.911125+0000","last_change":"2024-09-15T12:17:30.854853+0000","last_active":"2024-09-15T12:29:19.911125+0000","last_peered":"2024-09-15T12:29:19.911125+0000","last_clean":"2024-09-15T12:29:19.911125+0000","last_became_active":"2024-09-15T12:17:28.906861+0000","last_became_peered":"2024-09-15T12:17:28.906861+0000","last_unstale":"2024-09-15T12:29:19.911125+0000","last_undegraded":"2024-09-15T12:29:19.911125+0000","last_fullsized":"2024-09-15T12:29:19.911125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":575,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-15T12:29:20.922237+0000","last_change":"2024-09-15T12:17:30.855086+0000","last_active":"2024-09-15T12:29:20.922237+0000","last_peered":"2024-09-15T12:29:20.922237+0000","last_clean":"2024-09-15T12:29:20.922237+0000","last_became_active":"2024-09-15T12:17:28.912738+0000","last_became_peered":"2024-09-15T12:17:28.912738+0000","last_unstale":"2024-09-15T12:29:20.922237+0000","last_undegraded":"2024-09-15T12:29:20.922237+0000","last_fullsized":"2024-09-15T12:29:20.922237+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.909843+0000","last_change":"2024-09-15T12:17:30.853570+0000","last_active":"2024-09-15T12:29:19.909843+0000","last_peered":"2024-09-15T12:29:19.909843+0000","last_clean":"2024-09-15T12:29:19.909843+0000","last_became_active":"2024-09-15T12:17:28.942066+0000","last_became_peered":"2024-09-15T12:17:28.942066+0000","last_unstale":"2024-09-15T12:29:19.909843+0000","last_undegraded":"2024-09-15T12:29:19.909843+0000","last_fullsized":"2024-09-15T12:29:19.909843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":570,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.910161+0000","last_change":"2024-09-15T12:17:30.849969+0000","last_active":"2024-09-15T12:29:19.910161+0000","last_peered":"2024-09-15T12:29:19.910161+0000","last_clean":"2024-09-15T12:29:19.910161+0000","last_became_active":"2024-09-15T12:17:28.906828+0000","last_became_peered":"2024-09-15T12:17:28.906828+0000","last_unstale":"2024-09-15T12:29:19.910161+0000","last_undegraded":"2024-09-15T12:29:19.910161+0000","last_fullsized":"2024-09-15T12:29:19.910161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":571,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.924824+0000","last_change":"2024-09-15T12:17:30.859057+0000","last_active":"2024-09-15T12:29:19.924824+0000","last_peered":"2024-09-15T12:29:19.924824+0000","last_clean":"2024-09-15T12:29:19.924824+0000","last_became_active":"2024-09-15T12:17:28.912555+0000","last_became_peered":"2024-09-15T12:17:28.912555+0000","last_unstale":"2024-09-15T12:29:19.924824+0000","last_undegraded":"2024-09-15T12:29:19.924824+0000","last_fullsized":"2024-09-15T12:29:19.924824+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:27.810823+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":645,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-15T12:29:19.905176+0000","last_change":"2024-09-15T12:17:22.585730+0000","last_active":"2024-09-15T12:29:19.905176+0000","last_peered":"2024-09-15T12:29:19.905176+0000","last_clean":"2024-09-15T12:29:19.905176+0000","last_became_active":"2024-09-15T12:17:22.575804+0000","last_became_peered":"2024-09-15T12:17:22.575804+0000","last_unstale":"2024-09-15T12:29:19.905176+0000","last_undegraded":"2024-09-15T12:29:19.905176+0000","last_fullsized":"2024-09-15T12:29:19.905176+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:17:21.533890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:17:21.533890+0000","last_clean_scrub_stamp":"2024-09-15T12:17:21.533890+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28152,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1351680,"data_stored":566866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28216,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1417216,"data_stored":1157253,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28224,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1425408,"data_stored":1161069,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:29:46.798 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:46.799 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:46.799 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:46.799 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:46.799 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:46.799 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:46.799 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:46.799 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-15T12:17:27.810823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=27, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:46.799 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-15T12:17:21.533890+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=17, tm_sec=21, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=29, tm_sec=23, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:29:46.799 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-15T12:30:06.801 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:30:06.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:30:06.923+0000 7fbecba88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:06.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:30:06.931+0000 7fbecba88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:07.117 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-15T12:30:07.117 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-15T12:30:07.130 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":577,"stamp":"2024-09-15T12:30:06.695717+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":84684,"kb_used_data":4172,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283030836,"statfs":{"total":289910292480,"available":289823576064,"internally_reserved":0,"allocated":4272128,"data_stored":2915020,"data_compressed":60094,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002594"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":578,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-15T12:29:25.664247+0000","last_change":"2024-09-15T12:29:25.692359+0000","last_active":"2024-09-15T12:29:25.664247+0000","last_peered":"2024-09-15T12:29:25.664247+0000","last_clean":"2024-09-15T12:29:25.664247+0000","last_became_active":"2024-09-15T12:17:28.924258+0000","last_became_peered":"2024-09-15T12:17:28.924258+0000","last_unstale":"2024-09-15T12:29:25.664247+0000","last_undegraded":"2024-09-15T12:29:25.664247+0000","last_fullsized":"2024-09-15T12:29:25.664247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:29:25.692189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:29:25.692189+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":578,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-15T12:29:25.665580+0000","last_change":"2024-09-15T12:29:25.689018+0000","last_active":"2024-09-15T12:29:25.665580+0000","last_peered":"2024-09-15T12:29:25.665580+0000","last_clean":"2024-09-15T12:29:25.665580+0000","last_became_active":"2024-09-15T12:17:28.953744+0000","last_became_peered":"2024-09-15T12:17:28.953744+0000","last_unstale":"2024-09-15T12:29:25.665580+0000","last_undegraded":"2024-09-15T12:29:25.665580+0000","last_fullsized":"2024-09-15T12:29:25.665580+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:29:25.688853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:29:25.688853+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":578,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-15T12:29:25.663121+0000","last_change":"2024-09-15T12:29:25.690490+0000","last_active":"2024-09-15T12:29:25.663121+0000","last_peered":"2024-09-15T12:29:25.663121+0000","last_clean":"2024-09-15T12:29:25.663121+0000","last_became_active":"2024-09-15T12:17:28.934272+0000","last_became_peered":"2024-09-15T12:17:28.934272+0000","last_unstale":"2024-09-15T12:29:25.663121+0000","last_undegraded":"2024-09-15T12:29:25.663121+0000","last_fullsized":"2024-09-15T12:29:25.663121+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:29:25.690203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:29:25.690203+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":578,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-15T12:29:25.661985+0000","last_change":"2024-09-15T12:29:25.686475+0000","last_active":"2024-09-15T12:29:25.661985+0000","last_peered":"2024-09-15T12:29:25.661985+0000","last_clean":"2024-09-15T12:29:25.661985+0000","last_became_active":"2024-09-15T12:17:28.906861+0000","last_became_peered":"2024-09-15T12:17:28.906861+0000","last_unstale":"2024-09-15T12:29:25.661985+0000","last_undegraded":"2024-09-15T12:29:25.661985+0000","last_fullsized":"2024-09-15T12:29:25.661985+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:29:25.686288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:29:25.686288+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":580,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-15T12:29:25.199008+0000","last_change":"2024-09-15T12:29:25.210483+0000","last_active":"2024-09-15T12:29:25.199008+0000","last_peered":"2024-09-15T12:29:25.199008+0000","last_clean":"2024-09-15T12:29:25.199008+0000","last_became_active":"2024-09-15T12:17:28.912738+0000","last_became_peered":"2024-09-15T12:17:28.912738+0000","last_unstale":"2024-09-15T12:29:25.199008+0000","last_undegraded":"2024-09-15T12:29:25.199008+0000","last_fullsized":"2024-09-15T12:29:25.199008+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2024-09-15T12:29:25.210296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:29:25.210296+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":578,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-15T12:29:26.135118+0000","last_change":"2024-09-15T12:29:26.143719+0000","last_active":"2024-09-15T12:29:26.135118+0000","last_peered":"2024-09-15T12:29:26.135118+0000","last_clean":"2024-09-15T12:29:26.135118+0000","last_became_active":"2024-09-15T12:17:28.942066+0000","last_became_peered":"2024-09-15T12:17:28.942066+0000","last_unstale":"2024-09-15T12:29:26.135118+0000","last_undegraded":"2024-09-15T12:29:26.135118+0000","last_fullsized":"2024-09-15T12:29:26.135118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:29:26.143423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:29:26.143423+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":578,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-15T12:29:26.133867+0000","last_change":"2024-09-15T12:29:26.140992+0000","last_active":"2024-09-15T12:29:26.133867+0000","last_peered":"2024-09-15T12:29:26.133867+0000","last_clean":"2024-09-15T12:29:26.133867+0000","last_became_active":"2024-09-15T12:17:28.906828+0000","last_became_peered":"2024-09-15T12:17:28.906828+0000","last_unstale":"2024-09-15T12:29:26.133867+0000","last_undegraded":"2024-09-15T12:29:26.133867+0000","last_fullsized":"2024-09-15T12:29:26.133867+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:29:26.140825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:29:26.140825+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":579,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-15T12:29:25.660593+0000","last_change":"2024-09-15T12:29:25.683964+0000","last_active":"2024-09-15T12:29:25.660593+0000","last_peered":"2024-09-15T12:29:25.660593+0000","last_clean":"2024-09-15T12:29:25.660593+0000","last_became_active":"2024-09-15T12:17:28.912555+0000","last_became_peered":"2024-09-15T12:17:28.912555+0000","last_unstale":"2024-09-15T12:29:25.660593+0000","last_undegraded":"2024-09-15T12:29:25.660593+0000","last_fullsized":"2024-09-15T12:29:25.660593+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-15T12:29:25.683638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:29:25.683638+0000","last_clean_scrub_stamp":"2024-09-15T12:17:27.810823+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":653,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-15T12:29:25.660524+0000","last_change":"2024-09-15T12:29:25.694570+0000","last_active":"2024-09-15T12:29:25.660524+0000","last_peered":"2024-09-15T12:29:25.660524+0000","last_clean":"2024-09-15T12:29:25.660524+0000","last_became_active":"2024-09-15T12:17:22.575804+0000","last_became_peered":"2024-09-15T12:17:22.575804+0000","last_unstale":"2024-09-15T12:29:25.660524+0000","last_undegraded":"2024-09-15T12:29:25.660524+0000","last_fullsized":"2024-09-15T12:29:25.660524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"10'52","last_scrub_stamp":"2024-09-15T12:29:25.694365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:29:25.694365+0000","last_clean_scrub_stamp":"2024-09-15T12:17:21.533890+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739116,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28180,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1380352,"data_stored":578082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739116,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28252,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1445888,"data_stored":1168469,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28252,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1445888,"data_stored":1168469,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30047,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:30:07.131 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-15T12:30:07.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:30:07.229+0000 7f64b0d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:07.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-15T12:30:07.241+0000 7f64b0d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:07.450 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-15T12:30:07.450 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-15T12:30:07.451 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-15T12:30:07.451 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:30:07.531 INFO:tasks.ceph.osd.0:Stopped 2024-09-15T12:30:07.531 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-15T12:30:07.531 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:30:07.622 INFO:tasks.ceph.osd.1:Stopped 2024-09-15T12:30:07.622 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-15T12:30:07.622 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:30:07.701 INFO:tasks.ceph.osd.2:Stopped 2024-09-15T12:30:07.702 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-15T12:30:07.702 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-15T12:30:07.702 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:30:07.730 INFO:tasks.ceph.mgr.x:Stopped 2024-09-15T12:30:07.730 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-15T12:30:07.730 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-15T12:30:07.730 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:30:07.784 INFO:tasks.ceph.mon.a:Stopped 2024-09-15T12:30:07.785 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-15T12:30:07.785 DEBUG:teuthology.orchestra.run.smithi092:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'is full \(reached quota' | egrep -v '\(POOL_FULL\)' | head -n 1 2024-09-15T12:30:07.852 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi092.front.sepia.ceph.com 2024-09-15T12:30:07.852 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-15T12:30:08.030 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi092.front.sepia.ceph.com 2024-09-15T12:30:08.031 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-15T12:30:08.136 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi092.front.sepia.ceph.com 2024-09-15T12:30:08.137 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-15T12:30:08.201 INFO:tasks.ceph:Archiving mon data... 2024-09-15T12:30:08.202 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905527/data/mon.a.tgz 2024-09-15T12:30:08.203 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2024-09-15T12:30:08.217 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.BAjriLhdUd 2024-09-15T12:30:08.217 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.BAjriLhdUd 2024-09-15T12:30:08.340 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.BAjriLhdUd 2024-09-15T12:30:08.423 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.BAjriLhdUd is 236KB 2024-09-15T12:30:08.517 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.BAjriLhdUd 2024-09-15T12:30:08.532 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-15T12:30:08.532 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T12:30:08.651 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T12:30:08.651 INFO:tasks.ceph:Archiving crash dumps... 2024-09-15T12:30:08.652 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905527/remote/smithi092/crash 2024-09-15T12:30:08.653 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T12:30:08.714 INFO:tasks.ceph:Compressing logs... 2024-09-15T12:30:08.714 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T12:30:08.780 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-15T12:30:08.780 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34366.log 2024-09-15T12:30:08.780 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34679.log 2024-09-15T12:30:08.780 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.34366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30987.log 2024-09-15T12:30:08.780 INFO:teuthology.orchestra.run.smithi092.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.34366.log.gz 2024-09-15T12:30:08.780 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.34679.log: gzip -5 49.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.34679.log.gz /var/log/ceph/ceph-client.admin.33257.log 2024-09-15T12:30:08.780 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-09-15T12:30:08.802 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30265.log 2024-09-15T12:30:08.803 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30987.log: /var/log/ceph/ceph-client.admin.33257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30685.log 2024-09-15T12:30:08.803 INFO:teuthology.orchestra.run.smithi092.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.33257.log.gz 2024-09-15T12:30:08.803 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30265.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-15T12:30:08.803 INFO:teuthology.orchestra.run.smithi092.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.30987.log.gz 2024-09-15T12:30:08.803 INFO:teuthology.orchestra.run.smithi092.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30265.log.gz 2024-09-15T12:30:08.803 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30473.log 2024-09-15T12:30:08.803 INFO:teuthology.orchestra.run.smithi092.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30685.log.gz 2024-09-15T12:30:08.803 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30349.log 2024-09-15T12:30:08.803 INFO:teuthology.orchestra.run.smithi092.stderr:gzip/var/log/ceph/ceph-client.admin.30473.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30727.log 2024-09-15T12:30:08.803 INFO:teuthology.orchestra.run.smithi092.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30473.log.gz 2024-09-15T12:30:08.803 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30349.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30349.log.gz 2024-09-15T12:30:08.803 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30307.log 2024-09-15T12:30:08.803 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35015.log 2024-09-15T12:30:08.804 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30727.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30727.log.gz 2024-09-15T12:30:08.804 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30189.log/var/log/ceph/ceph-client.admin.30307.log: 2024-09-15T12:30:08.804 INFO:teuthology.orchestra.run.smithi092.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30307.log.gz 2024-09-15T12:30:08.804 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.35015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30599.log 2024-09-15T12:30:08.804 INFO:teuthology.orchestra.run.smithi092.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35015.log.gz 2024-09-15T12:30:08.804 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30189.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.34415.log 2024-09-15T12:30:08.804 INFO:teuthology.orchestra.run.smithi092.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30189.log.gz 2024-09-15T12:30:08.804 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30599.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T12:30:08.804 INFO:teuthology.orchestra.run.smithi092.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30599.log.gz 2024-09-15T12:30:08.804 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.34415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33614.log 2024-09-15T12:30:08.804 INFO:teuthology.orchestra.run.smithi092.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.34415.log.gz 2024-09-15T12:30:08.804 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35100.log 2024-09-15T12:30:08.804 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.33614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34595.log 2024-09-15T12:30:08.804 INFO:teuthology.orchestra.run.smithi092.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T12:30:08.805 INFO:teuthology.orchestra.run.smithi092.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.33614.log.gz 2024-09-15T12:30:08.805 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.35100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29484.log 2024-09-15T12:30:08.805 INFO:teuthology.orchestra.run.smithi092.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35100.log.gz 2024-09-15T12:30:08.805 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.34595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29678.log 2024-09-15T12:30:08.805 INFO:teuthology.orchestra.run.smithi092.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34595.log.gz 2024-09-15T12:30:08.805 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.29484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30073.log 2024-09-15T12:30:08.805 INFO:teuthology.orchestra.run.smithi092.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29484.log.gz 2024-09-15T12:30:08.805 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.29678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34763.log 2024-09-15T12:30:08.805 INFO:teuthology.orchestra.run.smithi092.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29678.log.gz 2024-09-15T12:30:08.805 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30073.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27824.log 2024-09-15T12:30:08.805 INFO:teuthology.orchestra.run.smithi092.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30073.log.gz 2024-09-15T12:30:08.805 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.34763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33001.log 2024-09-15T12:30:08.805 INFO:teuthology.orchestra.run.smithi092.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34763.log.gz 2024-09-15T12:30:08.805 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph.tmp-client.admin.27824.log: 66.9% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27824.log.gz 2024-09-15T12:30:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30598.log 2024-09-15T12:30:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.33001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34973.log 2024-09-15T12:30:08.806 INFO:teuthology.orchestra.run.smithi092.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.33001.log.gz 2024-09-15T12:30:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30559.log 2024-09-15T12:30:08.806 INFO:teuthology.orchestra.run.smithi092.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30598.log.gz 2024-09-15T12:30:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.34973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33321.log 2024-09-15T12:30:08.806 INFO:teuthology.orchestra.run.smithi092.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34973.log.gz 2024-09-15T12:30:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33562.log 2024-09-15T12:30:08.806 INFO:teuthology.orchestra.run.smithi092.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30559.log.gz 2024-09-15T12:30:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.33321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29399.log 2024-09-15T12:30:08.806 INFO:teuthology.orchestra.run.smithi092.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.33321.log.gz 2024-09-15T12:30:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.33562.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33562.log.gz 2024-09-15T12:30:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34889.log 2024-09-15T12:30:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29289.log 2024-09-15T12:30:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.29399.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29399.log.gz 2024-09-15T12:30:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.34889.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-15T12:30:08.807 INFO:teuthology.orchestra.run.smithi092.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34889.log.gz 2024-09-15T12:30:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.29289.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29289.log.gz 2024-09-15T12:30:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29439.log 2024-09-15T12:30:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30769.log 2024-09-15T12:30:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.29439.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29439.log.gz 2024-09-15T12:30:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30472.log 2024-09-15T12:30:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33385.log 2024-09-15T12:30:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30769.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30769.log.gz 2024-09-15T12:30:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34847.log 2024-09-15T12:30:08.807 INFO:teuthology.orchestra.run.smithi092.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30472.log.gz 2024-09-15T12:30:08.808 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.33385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34118.log 2024-09-15T12:30:08.808 INFO:teuthology.orchestra.run.smithi092.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.33385.log.gz 2024-09-15T12:30:08.808 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.34847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34931.log 2024-09-15T12:30:08.808 INFO:teuthology.orchestra.run.smithi092.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34847.log.gz 2024-09-15T12:30:08.808 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.34118.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-15T12:30:08.808 INFO:teuthology.orchestra.run.smithi092.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.34118.log.gz 2024-09-15T12:30:08.808 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.34931.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T12:30:08.808 INFO:teuthology.orchestra.run.smithi092.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34931.log.gz 2024-09-15T12:30:08.808 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33193.log 2024-09-15T12:30:08.808 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33065.log 2024-09-15T12:30:08.808 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.33193.log: gzip -5 --verbose -- 82.3% -- replaced with /var/log/ceph/ceph-client.admin.33193.log.gz 2024-09-15T12:30:08.808 INFO:teuthology.orchestra.run.smithi092.stderr: /var/log/ceph/ceph-client.admin.33513.log 2024-09-15T12:30:08.808 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.33065.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.33065.log.gz 2024-09-15T12:30:08.808 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-15T12:30:08.809 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.33513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30391.log 84.9% -- replaced with /var/log/ceph/ceph-client.admin.33513.log.gz 2024-09-15T12:30:08.809 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-09-15T12:30:08.809 INFO:teuthology.orchestra.run.smithi092.stderr: 88.0%/var/log/ceph/ceph-mgr.x.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T12:30:08.809 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33129.log 2024-09-15T12:30:08.809 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30391.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30391.log.gz 2024-09-15T12:30:08.809 INFO:teuthology.orchestra.run.smithi092.stderr: -- /var/log/ceph/ceph-client.admin.29648.log 2024-09-15T12:30:08.809 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.33129.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.33129.log.gz 2024-09-15T12:30:08.809 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34219.log 2024-09-15T12:30:08.809 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.29648.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29648.log.gz 2024-09-15T12:30:08.809 INFO:teuthology.orchestra.run.smithi092.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30133.log 2024-09-15T12:30:08.809 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.34219.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.34219.log.gz 2024-09-15T12:30:08.809 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34167.log 2024-09-15T12:30:08.809 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5/var/log/ceph/ceph-client.admin.30133.log: --verbose -- /var/log/ceph/ceph-client.admin.34317.log 2024-09-15T12:30:08.809 INFO:teuthology.orchestra.run.smithi092.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30133.log.gz 2024-09-15T12:30:08.809 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.34167.log: 76.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34553.log 2024-09-15T12:30:08.810 INFO:teuthology.orchestra.run.smithi092.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34167.log.gz 2024-09-15T12:30:08.810 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.34317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34805.log 2024-09-15T12:30:08.810 INFO:teuthology.orchestra.run.smithi092.stderr: 76.3% -- replaced with /var/log/ceph/ceph-client.admin.34317.log.gz 2024-09-15T12:30:08.810 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.34553.log: /var/log/ceph/ceph-client.admin.29201.log 2024-09-15T12:30:08.810 INFO:teuthology.orchestra.run.smithi092.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34553.log.gz/var/log/ceph/ceph-client.admin.34805.log: 2024-09-15T12:30:08.810 INFO:teuthology.orchestra.run.smithi092.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34805.log.gz 2024-09-15T12:30:08.810 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30214.log 2024-09-15T12:30:08.810 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.29201.log: gzip -5 --verbose 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29201.log.gz 2024-09-15T12:30:08.810 INFO:teuthology.orchestra.run.smithi092.stderr: -- /var/log/ceph/ceph-client.admin.34268.log 2024-09-15T12:30:08.810 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30214.log: gzip 65.6% -- replaced with /var/log/ceph/ceph-client.admin.30214.log.gz 2024-09-15T12:30:08.810 INFO:teuthology.orchestra.run.smithi092.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34637.log 2024-09-15T12:30:08.810 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.34268.log: 76.2% -- replaced with /var/log/ceph/ceph-client.admin.34268.log.gz 2024-09-15T12:30:08.810 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33449.log 2024-09-15T12:30:08.810 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.34637.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34637.log.gz 2024-09-15T12:30:08.811 INFO:teuthology.orchestra.run.smithi092.stderr: /var/log/ceph/ceph-client.admin.35059.log 2024-09-15T12:30:08.811 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.33449.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.33449.log.gz 2024-09-15T12:30:08.811 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30471.log 2024-09-15T12:30:08.811 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5/var/log/ceph/ceph-client.admin.35059.log: --verbose -- /var/log/ceph/ceph-client.admin.34721.log 2024-09-15T12:30:08.811 INFO:teuthology.orchestra.run.smithi092.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35059.log.gz 2024-09-15T12:30:08.811 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.30471.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30471.log.gz 2024-09-15T12:30:08.811 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.34721.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34721.log.gz 2024-09-15T12:30:08.869 INFO:teuthology.orchestra.run.smithi092.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-15T12:30:09.085 INFO:teuthology.orchestra.run.smithi092.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-15T12:30:12.796 INFO:teuthology.orchestra.run.smithi092.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-15T12:30:14.243 INFO:teuthology.orchestra.run.smithi092.stderr: 95.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-15T12:30:15.329 INFO:teuthology.orchestra.run.smithi092.stderr: 95.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-15T12:30:15.331 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-09-15T12:30:15.331 INFO:teuthology.orchestra.run.smithi092.stderr:real 0m6.561s 2024-09-15T12:30:15.331 INFO:teuthology.orchestra.run.smithi092.stderr:user 0m15.737s 2024-09-15T12:30:15.331 INFO:teuthology.orchestra.run.smithi092.stderr:sys 0m0.686s 2024-09-15T12:30:15.331 INFO:tasks.ceph:Archiving logs... 2024-09-15T12:30:15.332 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905527/remote/smithi092/log 2024-09-15T12:30:15.333 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T12:30:17.472 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T12:30:17.483 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T12:30:17.483 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T12:30:17.542 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T12:30:17.553 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T12:30:17.554 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T12:30:17.571 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-09-15T12:30:17.576 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T12:30:17.576 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-09-15T12:30:17.576 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 18 +522us[ +522us] +/- 38ms 2024-09-15T12:30:17.576 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv02.front.sepia.ceph.com 3 6 377 18 -789us[ -787us] +/- 50ms 2024-09-15T12:30:17.576 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +162us[ +162us] +/- 72ms 2024-09-15T12:30:17.576 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:30:17.577 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T12:30:17.598 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T12:30:17.598 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T12:30:17.631 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T12:30:17.695 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T12:30:17.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:30:17.723 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T12:30:17.734 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T12:30:17.762 INFO:teuthology.task.internal:Duration was 1235.951265 seconds 2024-09-15T12:30:17.763 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T12:30:17.842 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T12:30:17.842 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T12:30:17.882 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T12:30:18.087 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T12:30:18.088 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2024-09-15T12:30:18.088 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T12:30:18.147 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T12:30:18.148 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T12:30:18.214 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T12:30:18.214 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T12:30:18.352 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T12:30:18.361 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T12:30:18.361 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T12:30:18.385 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T12:30:18.398 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T12:30:18.449 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2024-09-15T12:30:18.462 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T12:30:18.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:30:18.516 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T12:30:18.525 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T12:30:18.526 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905527/remote/smithi092 2024-09-15T12:30:18.526 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T12:30:18.589 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T12:30:18.589 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T12:30:18.639 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T12:30:18.648 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T12:30:18.648 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T12:30:18.677 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T12:30:18.677 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T12:30:18.693 INFO:teuthology.orchestra.run.smithi092.stdout: 266064 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 12:30 /home/ubuntu/cephtest 2024-09-15T12:30:18.694 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T12:30:18.711 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T12:30:18.784 INFO:teuthology.run:Summary data: description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests_old_format} duration: 1235.951265335083 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-15T12:30:18.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T12:30:18.889 INFO:teuthology.run:pass