2024-09-18T12:47:41.600 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-18T12:47:41.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T12:47:41.697 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911397 branch: main description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests} email: null first_in_suite: false job_id: '7911397' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-1 osd.1: crimson seastar cpu cores: 2-3 osd.2: crimson seastar cpu cores: 4-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_APP_NOT_ENABLED\) - is full \(reached quota - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(POOL_FULL\) sha1: 090e6509f8ae300193b1735deab951d46056ec88 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: crimson sha1: 090e6509f8ae300193b1735deab951d46056ec88 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_nmordech@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 2042 sha1: 090e6509f8ae300193b1735deab951d46056ec88 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHymDE/gns2lex+xzinywHiylHe1CwgrwZTAZIgBqGxLuFtTDE1JhfCFoVH/0FZ6haFKWnYoFMrVVA5SUiCYS9A= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rbd/crimson/test_crimson_librbd.sh env: RBD_FEATURES: '61' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_12:39:24 tube: smithi user: nmordech verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-18T12:47:41.697 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-18T12:47:41.698 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-18T12:47:41.698 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-18T12:47:41.700 INFO:teuthology.task.internal:Checking packages... 2024-09-18T12:47:41.722 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '090e6509f8ae300193b1735deab951d46056ec88' 2024-09-18T12:47:41.722 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:47:41.723 INFO:teuthology.packaging:ref: None 2024-09-18T12:47:41.723 INFO:teuthology.packaging:tag: None 2024-09-18T12:47:41.723 INFO:teuthology.packaging:branch: main 2024-09-18T12:47:41.723 INFO:teuthology.packaging:sha1: 090e6509f8ae300193b1735deab951d46056ec88 2024-09-18T12:47:41.723 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=main 2024-09-18T12:47:41.921 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4987.g5ecc7400 2024-09-18T12:47:41.922 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-18T12:47:41.929 INFO:teuthology.task.internal:no buildpackages task found 2024-09-18T12:47:41.929 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-18T12:47:41.935 INFO:teuthology.task.internal:Saving configuration 2024-09-18T12:47:41.947 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-18T12:47:41.955 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-18T12:47:41.978 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911397', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 12:42:17.802175', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHymDE/gns2lex+xzinywHiylHe1CwgrwZTAZIgBqGxLuFtTDE1JhfCFoVH/0FZ6haFKWnYoFMrVVA5SUiCYS9A='} 2024-09-18T12:47:41.978 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-18T12:47:41.984 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-09-18T12:47:41.984 INFO:teuthology.run_tasks:Running task console_log... 2024-09-18T12:47:42.018 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f93763a3f40>, signals=[15]) 2024-09-18T12:47:42.018 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-18T12:47:42.024 INFO:teuthology.task.internal:Opening connections... 2024-09-18T12:47:42.024 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2024-09-18T12:47:42.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:47:42.103 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-18T12:47:42.109 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2024-09-18T12:47:42.187 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2024-09-18T12:47:42.187 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-09-18T12:47:42.244 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream" 2024-09-18T12:47:42.244 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="9" 2024-09-18T12:47:42.245 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos" 2024-09-18T12:47:42.245 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora" 2024-09-18T12:47:42.245 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="9" 2024-09-18T12:47:42.245 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el9" 2024-09-18T12:47:42.245 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T12:47:42.245 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2024-09-18T12:47:42.245 INFO:teuthology.orchestra.run.smithi178.stdout:LOGO="fedora-logo-icon" 2024-09-18T12:47:42.245 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T12:47:42.245 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/" 2024-09-18T12:47:42.245 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T12:47:42.245 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T12:47:42.245 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T12:47:42.246 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-09-18T12:47:42.266 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-18T12:47:42.274 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-18T12:47:42.279 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-18T12:47:42.279 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2024-09-18T12:47:42.302 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-18T12:47:42.308 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-18T12:47:42.308 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2024-09-18T12:47:42.370 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-18T12:47:42.400 INFO:teuthology.run_tasks:Running task kernel... 2024-09-18T12:47:42.413 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-18T12:47:42.414 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-18T12:47:42.414 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T12:47:42.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:47:42.430 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2024-09-18T12:47:42.486 INFO:teuthology.orchestra.run.smithi178.stdout:5.14.0-503.el9.x86_64 2024-09-18T12:47:42.486 INFO:teuthology.task.kernel:Running kernel on smithi178: 5.14.0-503.el9.x86_64 2024-09-18T12:47:42.487 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum install -y kernel 2024-09-18T12:47:45.156 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-18T12:47:48.482 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - AppStream 9.1 MB/s | 20 MB 00:02 2024-09-18T12:47:52.974 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 6.5 MB 00:00 2024-09-18T12:47:54.433 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 19 kB 00:00 2024-09-18T12:47:55.953 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-18T12:48:01.417 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-18T12:48:03.340 INFO:teuthology.orchestra.run.smithi178.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T12:48:03.340 INFO:teuthology.orchestra.run.smithi178.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T12:48:03.436 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:48:03.446 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:48:03.446 INFO:teuthology.orchestra.run.smithi178.stdout: Package Architecture Version Repository Size 2024-09-18T12:48:03.446 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:48:03.446 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:48:03.446 INFO:teuthology.orchestra.run.smithi178.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T12:48:03.446 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-18T12:48:03.446 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T12:48:03.446 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T12:48:03.446 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T12:48:03.447 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:48:03.447 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:48:03.447 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:48:03.447 INFO:teuthology.orchestra.run.smithi178.stdout:Install 4 Packages 2024-09-18T12:48:03.447 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:48:03.447 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 79 M 2024-09-18T12:48:03.447 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 126 M 2024-09-18T12:48:03.447 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:48:03.785 INFO:teuthology.orchestra.run.smithi178.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 442 kB/s | 36 kB 00:00 2024-09-18T12:48:06.793 INFO:teuthology.orchestra.run.smithi178.stdout:(2/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 11 MB/s | 35 MB 00:03 2024-09-18T12:48:07.227 INFO:teuthology.orchestra.run.smithi178.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 8.3 MB/s | 29 MB 00:03 2024-09-18T12:48:07.394 INFO:teuthology.orchestra.run.smithi178.stdout:(4/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.2 MB/s | 16 MB 00:03 2024-09-18T12:48:07.394 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:48:07.394 INFO:teuthology.orchestra.run.smithi178.stdout:Total 20 MB/s | 79 MB 00:03 2024-09-18T12:48:08.077 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:48:08.424 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:48:08.424 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:48:09.390 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:48:09.390 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:48:11.832 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:48:12.496 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:48:12.585 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:48:15.354 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:48:15.507 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:48:20.334 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:48:20.383 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:48:25.213 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:49:03.516 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:49:03.555 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:49:03.944 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:49:03.945 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:49:03.945 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:49:03.945 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:49:04.811 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:49:04.811 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:49:04.811 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:49:04.811 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T12:49:04.811 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T12:49:04.812 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T12:49:04.812 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T12:49:04.812 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:49:04.812 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:49:05.190 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:49:05.282 INFO:teuthology.orchestra.run.smithi178.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:49:05.282 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:49:05.283 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T12:49:05.283 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T12:49:05.283 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T12:49:05.283 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-18T12:49:05.283 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi178.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T12:49:05.283 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:49:05.342 INFO:teuthology.orchestra.run.smithi178.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:49:05.343 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:49:05.343 DEBUG:teuthology.orchestra.run.smithi178:> sudo rpm -qi grub2-tools 2024-09-18T12:49:05.375 INFO:teuthology.orchestra.run.smithi178.stdout:Name : grub2-tools 2024-09-18T12:49:05.375 INFO:teuthology.orchestra.run.smithi178.stdout:Epoch : 1 2024-09-18T12:49:05.375 INFO:teuthology.orchestra.run.smithi178.stdout:Version : 2.06 2024-09-18T12:49:05.375 INFO:teuthology.orchestra.run.smithi178.stdout:Release : 82.el9 2024-09-18T12:49:05.375 INFO:teuthology.orchestra.run.smithi178.stdout:Architecture: x86_64 2024-09-18T12:49:05.375 INFO:teuthology.orchestra.run.smithi178.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T12:49:05.375 INFO:teuthology.orchestra.run.smithi178.stdout:Group : Unspecified 2024-09-18T12:49:05.375 INFO:teuthology.orchestra.run.smithi178.stdout:Size : 8274670 2024-09-18T12:49:05.375 INFO:teuthology.orchestra.run.smithi178.stdout:License : GPLv3+ 2024-09-18T12:49:05.375 INFO:teuthology.orchestra.run.smithi178.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T12:49:05.375 INFO:teuthology.orchestra.run.smithi178.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T12:49:05.375 INFO:teuthology.orchestra.run.smithi178.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T12:49:05.376 INFO:teuthology.orchestra.run.smithi178.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T12:49:05.376 INFO:teuthology.orchestra.run.smithi178.stdout:Packager : builder@centos.org 2024-09-18T12:49:05.376 INFO:teuthology.orchestra.run.smithi178.stdout:Vendor : CentOS 2024-09-18T12:49:05.376 INFO:teuthology.orchestra.run.smithi178.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T12:49:05.376 INFO:teuthology.orchestra.run.smithi178.stdout:Summary : Support tools for GRUB. 2024-09-18T12:49:05.376 INFO:teuthology.orchestra.run.smithi178.stdout:Description : 2024-09-18T12:49:05.376 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:49:05.376 INFO:teuthology.orchestra.run.smithi178.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T12:49:05.376 INFO:teuthology.orchestra.run.smithi178.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T12:49:05.376 INFO:teuthology.orchestra.run.smithi178.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T12:49:05.376 INFO:teuthology.orchestra.run.smithi178.stdout:hardware devices. 2024-09-18T12:49:05.376 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:49:05.376 INFO:teuthology.orchestra.run.smithi178.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T12:49:05.377 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T12:49:05.377 INFO:teuthology.task.kernel:Updating grub on smithi178 to boot 5.14.0-508.el9.x86_64 2024-09-18T12:49:05.377 DEBUG:teuthology.orchestra.run.smithi178:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T12:49:06.026 INFO:teuthology.orchestra.run.smithi178.stderr:Generating grub configuration file ... 2024-09-18T12:49:07.367 INFO:teuthology.orchestra.run.smithi178.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T12:49:07.400 INFO:teuthology.orchestra.run.smithi178.stderr:done 2024-09-18T12:49:07.402 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2024-09-18T12:49:07.417 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.DHwLn4vrtk 2024-09-18T12:49:07.418 DEBUG:teuthology.orchestra.run.smithi178:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DHwLn4vrtk 2024-09-18T12:49:07.491 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.DHwLn4vrtk 2024-09-18T12:49:07.629 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.DHwLn4vrtk is 6KB 2024-09-18T12:49:07.678 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.DHwLn4vrtk 2024-09-18T12:49:07.693 DEBUG:teuthology.orchestra.run.smithi178:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T12:49:07.756 INFO:teuthology.orchestra.run.smithi178.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T12:49:07.756 INFO:teuthology.orchestra.run.smithi178.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T12:49:07.756 INFO:teuthology.orchestra.run.smithi178.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T12:49:07.756 INFO:teuthology.orchestra.run.smithi178.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T12:49:07.757 DEBUG:teuthology.orchestra.run.smithi178:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T12:49:07.910 DEBUG:teuthology.orchestra.run.smithi178:> sudo shutdown -r now 2024-09-18T12:49:37.941 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-18T12:49:37.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-18T12:49:37.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:50:12.413 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-09-18T12:50:21.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-18T12:50:21.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:50:24.477 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-09-18T12:50:36.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-18T12:50:36.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:51:08.325 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-09-18T12:51:08.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-18T12:51:08.759 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-18T12:51:08.760 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2024-09-18T12:51:08.774 INFO:teuthology.orchestra.run.smithi178.stdout:5.14.0-508.el9.x86_64 2024-09-18T12:51:08.774 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T12:51:08.775 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T12:51:08.775 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T12:51:09.775 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-18T12:51:09.776 DEBUG:teuthology.orchestra.run.smithi178:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T12:51:09.905 INFO:teuthology.orchestra.run.smithi178.stdout:ttyS1 2024-09-18T12:51:09.934 DEBUG:teuthology.parallel:result is None 2024-09-18T12:51:09.935 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-18T12:51:09.942 INFO:teuthology.task.internal:Creating test directory... 2024-09-18T12:51:09.942 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T12:51:09.983 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-18T12:51:09.990 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-18T12:51:10.000 INFO:teuthology.task.internal:Creating archive directory... 2024-09-18T12:51:10.000 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T12:51:10.077 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-18T12:51:10.084 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-18T12:51:10.084 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T12:51:10.153 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:51:10.172 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:51:10.174 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-18T12:51:10.181 INFO:teuthology.task.internal:Configuring sudo... 2024-09-18T12:51:10.181 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T12:51:10.251 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-18T12:51:10.260 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-18T12:51:10.260 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T12:51:10.294 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:51:10.405 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:51:10.466 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:51:10.509 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:51:10.585 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:51:10.585 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T12:51:10.611 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2024-09-18T12:51:10.693 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T12:51:10.730 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-18T12:51:10.738 INFO:teuthology.task.internal:Starting timer... 2024-09-18T12:51:10.738 INFO:teuthology.run_tasks:Running task pcp... 2024-09-18T12:51:10.749 INFO:teuthology.run_tasks:Running task selinux... 2024-09-18T12:51:10.757 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-18T12:51:10.758 DEBUG:teuthology.orchestra.run.smithi178:> sudo service auditd rotate 2024-09-18T12:51:10.966 INFO:teuthology.orchestra.run.smithi178.stdout:Rotating logs: 2024-09-18T12:51:10.968 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-18T12:51:10.968 DEBUG:teuthology.orchestra.run.smithi178:> /usr/sbin/getenforce 2024-09-18T12:51:11.095 INFO:teuthology.orchestra.run.smithi178.stdout:Permissive 2024-09-18T12:51:11.095 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi178.front.sepia.ceph.com': 'permissive'} 2024-09-18T12:51:11.096 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T12:51:11.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:51:11.124 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-18T12:51:11.124 DEBUG:teuthology.orchestra.run.smithi178:> sudo /usr/sbin/setenforce permissive 2024-09-18T12:51:11.284 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-18T12:51:11.294 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-18T12:51:11.306 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-18T12:51:11.307 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-18T12:54:52.258 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2024-09-18T12:54:52.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-18T12:54:52.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:54:52.338 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-09-18T12:54:52.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-18T12:54:52.416 INFO:teuthology.run_tasks:Running task clock... 2024-09-18T12:54:52.447 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-18T12:54:52.448 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T12:54:52.448 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T12:54:52.484 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T12:54:52.498 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T12:54:52.522 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: ntpd: command not found 2024-09-18T12:54:52.532 INFO:teuthology.orchestra.run.smithi178.stdout:506 Cannot talk to daemon 2024-09-18T12:54:52.546 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T12:54:52.560 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T12:54:52.618 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 1: ntpq: command not found 2024-09-18T12:54:52.622 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T12:54:52.622 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2024-09-18T12:54:52.622 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:54:52.622 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:54:52.622 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:54:52.622 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:54:52.623 INFO:teuthology.run_tasks:Running task install... 2024-09-18T12:54:52.631 DEBUG:teuthology.task.install:project ceph 2024-09-18T12:54:52.631 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '090e6509f8ae300193b1735deab951d46056ec88'}} 2024-09-18T12:54:52.631 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '090e6509f8ae300193b1735deab951d46056ec88'} 2024-09-18T12:54:52.631 INFO:teuthology.task.install:Using flavor: crimson 2024-09-18T12:54:52.637 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-18T12:54:52.637 INFO:teuthology.task.install:extra packages: [] 2024-09-18T12:54:52.637 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '090e6509f8ae300193b1735deab951d46056ec88', 'tag': None, 'wait_for_package': False} 2024-09-18T12:54:52.638 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=090e6509f8ae300193b1735deab951d46056ec88 2024-09-18T12:54:52.792 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-nitzan-crimson-enable-gate-assertions/090e6509f8ae300193b1735deab951d46056ec88/centos/9/flavors/crimson/ 2024-09-18T12:54:52.793 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4931.g090e6509 2024-09-18T12:54:52.919 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-nitzan-crimson-enable-gate-assertions/090e6509f8ae300193b1735deab951d46056ec88/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-nitzan-crimson-enable-gate-assertions/090e6509f8ae300193b1735deab951d46056ec88/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-nitzan-crimson-enable-gate-assertions/090e6509f8ae300193b1735deab951d46056ec88/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T12:54:52.919 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:54:52.919 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T12:54:52.945 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T12:54:52.945 DEBUG:teuthology.orchestra.run.smithi178:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/090e6509f8ae300193b1735deab951d46056ec88/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T12:54:53.011 DEBUG:teuthology.orchestra.run.smithi178:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T12:54:53.086 DEBUG:teuthology.orchestra.run.smithi178:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T12:54:53.150 INFO:teuthology.orchestra.run.smithi178.stdout:check_obsoletes = 1 2024-09-18T12:54:53.152 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum clean all 2024-09-18T12:54:53.380 INFO:teuthology.orchestra.run.smithi178.stdout:45 files removed 2024-09-18T12:54:53.406 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-radosgw 2024-09-18T12:54:53.967 INFO:teuthology.orchestra.run.smithi178.stdout:ceph packages for x86_64 320 kB/s | 88 kB 00:00 2024-09-18T12:54:54.259 INFO:teuthology.orchestra.run.smithi178.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-18T12:54:54.535 INFO:teuthology.orchestra.run.smithi178.stdout:ceph source packages 8.7 kB/s | 2.1 kB 00:00 2024-09-18T12:54:55.359 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.3 MB 00:00 2024-09-18T12:54:57.319 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-18T12:55:01.628 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-18T12:55:03.271 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-18T12:55:04.908 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-18T12:55:10.297 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-18T12:55:12.565 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:55:12.575 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:55:12.575 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-18T12:55:12.575 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:55:12.575 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:55:12.575 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw x86_64 2:19.3.0-4931.g090e6509.el9 ceph 10 M 2024-09-18T12:55:12.575 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrading: 2024-09-18T12:55:12.575 INFO:teuthology.orchestra.run.smithi178.stdout: librados2 x86_64 2:19.3.0-4931.g090e6509.el9 ceph 3.5 M 2024-09-18T12:55:12.575 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1 x86_64 2:19.3.0-4931.g090e6509.el9 ceph 3.8 M 2024-09-18T12:55:12.575 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-18T12:55:12.575 INFO:teuthology.orchestra.run.smithi178.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-18T12:55:12.576 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base x86_64 2:19.3.0-4931.g090e6509.el9 ceph 6.1 M 2024-09-18T12:55:12.576 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common x86_64 2:19.3.0-4931.g090e6509.el9 ceph 20 M 2024-09-18T12:55:12.576 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux x86_64 2:19.3.0-4931.g090e6509.el9 ceph 25 k 2024-09-18T12:55:12.576 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T12:55:12.576 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-18T12:55:12.576 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-18T12:55:12.576 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2 x86_64 2:19.3.0-4931.g090e6509.el9 ceph 809 k 2024-09-18T12:55:12.576 INFO:teuthology.orchestra.run.smithi178.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-18T12:55:12.576 INFO:teuthology.orchestra.run.smithi178.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T12:55:12.576 INFO:teuthology.orchestra.run.smithi178.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T12:55:12.576 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T12:55:12.577 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1 x86_64 2:19.3.0-4931.g090e6509.el9 ceph 557 k 2024-09-18T12:55:12.577 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T12:55:12.577 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2 x86_64 2:19.3.0-4931.g090e6509.el9 ceph 5.4 M 2024-09-18T12:55:12.577 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T12:55:12.577 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T12:55:12.577 INFO:teuthology.orchestra.run.smithi178.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-18T12:55:12.577 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse x86_64 2:19.3.0-4931.g090e6509.el9 ceph 45 k 2024-09-18T12:55:12.577 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common x86_64 2:19.3.0-4931.g090e6509.el9 ceph 143 k 2024-09-18T12:55:12.577 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs x86_64 2:19.3.0-4931.g090e6509.el9 ceph 160 k 2024-09-18T12:55:12.577 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T12:55:12.577 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados x86_64 2:19.3.0-4931.g090e6509.el9 ceph 315 k 2024-09-18T12:55:12.577 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd x86_64 2:19.3.0-4931.g090e6509.el9 ceph 302 k 2024-09-18T12:55:12.577 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw x86_64 2:19.3.0-4931.g090e6509.el9 ceph 99 k 2024-09-18T12:55:12.578 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-18T12:55:12.578 INFO:teuthology.orchestra.run.smithi178.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-18T12:55:12.578 INFO:teuthology.orchestra.run.smithi178.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-18T12:55:12.578 INFO:teuthology.orchestra.run.smithi178.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T12:55:12.578 INFO:teuthology.orchestra.run.smithi178.stdout:Installing weak dependencies: 2024-09-18T12:55:12.578 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-18T12:55:12.578 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:55:12.578 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:55:12.578 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:55:12.578 INFO:teuthology.orchestra.run.smithi178.stdout:Install 31 Packages 2024-09-18T12:55:12.578 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrade 2 Packages 2024-09-18T12:55:12.578 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:55:12.579 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 60 M 2024-09-18T12:55:12.579 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:55:13.490 INFO:teuthology.orchestra.run.smithi178.stdout:(1/33): ceph-base-19.3.0-4931.g090e6509.el9.x86 12 MB/s | 6.1 MB 00:00 2024-09-18T12:55:13.556 INFO:teuthology.orchestra.run.smithi178.stdout:(2/33): ceph-selinux-19.3.0-4931.g090e6509.el9. 378 kB/s | 25 kB 00:00 2024-09-18T12:55:13.690 INFO:teuthology.orchestra.run.smithi178.stdout:(3/33): ceph-radosgw-19.3.0-4931.g090e6509.el9. 14 MB/s | 10 MB 00:00 2024-09-18T12:55:13.732 INFO:teuthology.orchestra.run.smithi178.stdout:(4/33): libcephfs2-19.3.0-4931.g090e6509.el9.x8 4.5 MB/s | 809 kB 00:00 2024-09-18T12:55:13.774 INFO:teuthology.orchestra.run.smithi178.stdout:(5/33): libradosstriper1-19.3.0-4931.g090e6509. 6.5 MB/s | 557 kB 00:00 2024-09-18T12:55:13.849 INFO:teuthology.orchestra.run.smithi178.stdout:(6/33): python3-ceph-argparse-19.3.0-4931.g090e 603 kB/s | 45 kB 00:00 2024-09-18T12:55:13.958 INFO:teuthology.orchestra.run.smithi178.stdout:(7/33): librgw2-19.3.0-4931.g090e6509.el9.x86_6 24 MB/s | 5.4 MB 00:00 2024-09-18T12:55:13.983 INFO:teuthology.orchestra.run.smithi178.stdout:(8/33): python3-ceph-common-19.3.0-4931.g090e65 1.0 MB/s | 143 kB 00:00 2024-09-18T12:55:14.008 INFO:teuthology.orchestra.run.smithi178.stdout:(9/33): python3-cephfs-19.3.0-4931.g090e6509.el 3.1 MB/s | 160 kB 00:00 2024-09-18T12:55:14.042 INFO:teuthology.orchestra.run.smithi178.stdout:(10/33): python3-rados-19.3.0-4931.g090e6509.el 5.3 MB/s | 315 kB 00:00 2024-09-18T12:55:14.067 INFO:teuthology.orchestra.run.smithi178.stdout:(11/33): python3-rbd-19.3.0-4931.g090e6509.el9. 5.0 MB/s | 302 kB 00:00 2024-09-18T12:55:14.093 INFO:teuthology.orchestra.run.smithi178.stdout:(12/33): python3-rgw-19.3.0-4931.g090e6509.el9. 1.9 MB/s | 99 kB 00:00 2024-09-18T12:55:14.301 INFO:teuthology.orchestra.run.smithi178.stdout:(13/33): ceph-common-19.3.0-4931.g090e6509.el9. 15 MB/s | 20 MB 00:01 2024-09-18T12:55:14.443 INFO:teuthology.orchestra.run.smithi178.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 284 kB/s | 107 kB 00:00 2024-09-18T12:55:14.468 INFO:teuthology.orchestra.run.smithi178.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 454 kB/s | 171 kB 00:00 2024-09-18T12:55:14.494 INFO:teuthology.orchestra.run.smithi178.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-18T12:55:14.519 INFO:teuthology.orchestra.run.smithi178.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 737 kB/s | 160 kB 00:00 2024-09-18T12:55:14.572 INFO:teuthology.orchestra.run.smithi178.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 843 kB/s | 42 kB 00:00 2024-09-18T12:55:14.628 INFO:teuthology.orchestra.run.smithi178.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-18T12:55:14.661 INFO:teuthology.orchestra.run.smithi178.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-09-18T12:55:14.687 INFO:teuthology.orchestra.run.smithi178.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 612 kB/s | 36 kB 00:00 2024-09-18T12:55:14.712 INFO:teuthology.orchestra.run.smithi178.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-09-18T12:55:14.737 INFO:teuthology.orchestra.run.smithi178.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 626 kB/s | 47 kB 00:00 2024-09-18T12:55:14.796 INFO:teuthology.orchestra.run.smithi178.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 586 kB/s | 26 kB 00:00 2024-09-18T12:55:14.821 INFO:teuthology.orchestra.run.smithi178.stdout:(25/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.2 MB/s | 308 kB 00:00 2024-09-18T12:55:14.847 INFO:teuthology.orchestra.run.smithi178.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 965 kB/s | 49 kB 00:00 2024-09-18T12:55:14.872 INFO:teuthology.orchestra.run.smithi178.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-18T12:55:14.914 INFO:teuthology.orchestra.run.smithi178.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-18T12:55:14.956 INFO:teuthology.orchestra.run.smithi178.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-18T12:55:15.064 INFO:teuthology.orchestra.run.smithi178.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-18T12:55:15.140 INFO:teuthology.orchestra.run.smithi178.stdout:(31/33): librados2-19.3.0-4931.g090e6509.el9.x8 19 MB/s | 3.5 MB 00:00 2024-09-18T12:55:15.223 INFO:teuthology.orchestra.run.smithi178.stdout:(32/33): libarrow-9.0.0-11.el9.x86_64.rpm 8.6 MB/s | 4.4 MB 00:00 2024-09-18T12:55:15.323 INFO:teuthology.orchestra.run.smithi178.stdout:(33/33): librbd1-19.3.0-4931.g090e6509.el9.x86_ 15 MB/s | 3.8 MB 00:00 2024-09-18T12:55:15.328 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:55:15.328 INFO:teuthology.orchestra.run.smithi178.stdout:Total 22 MB/s | 60 MB 00:02 2024-09-18T12:55:15.440 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:55:15.477 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:55:15.477 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:55:16.166 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:55:16.167 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:55:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:55:18.173 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-18T12:55:18.225 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librados2-2:19.3.0-4931.g090e6509.el9.x86_64 2/35 2024-09-18T12:55:18.316 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:19.3.0-4931.g090e6509.el9.x86_64 2/35 2024-09-18T12:55:18.407 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rados-2:19.3.0-4931.g090e6509.el9.x86_64 3/35 2024-09-18T12:55:18.435 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs2-2:19.3.0-4931.g090e6509.el9.x86_64 4/35 2024-09-18T12:55:18.489 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephfs2-2:19.3.0-4931.g090e6509.el9.x86_64 4/35 2024-09-18T12:55:18.535 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-18T12:55:18.565 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-18T12:55:18.590 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-18T12:55:18.613 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-18T12:55:18.633 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-18T12:55:18.823 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-18T12:55:18.853 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-18T12:55:18.889 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-18T12:55:18.932 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-argparse-2:19.3.0-4931.g090e6509.el9. 11/35 2024-09-18T12:55:18.961 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cephfs-2:19.3.0-4931.g090e6509.el9.x86_64 12/35 2024-09-18T12:55:19.040 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-18T12:55:19.067 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libradosstriper1-2:19.3.0-4931.g090e6509.el9.x86_6 14/35 2024-09-18T12:55:19.164 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4931.g090e6509.el9.x86_6 14/35 2024-09-18T12:55:19.199 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-18T12:55:19.311 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-18T12:55:19.342 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-18T12:55:19.409 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-18T12:55:19.457 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-18T12:55:19.486 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-18T12:55:19.523 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-18T12:55:19.899 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-18T12:55:19.957 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librbd1-2:19.3.0-4931.g090e6509.el9.x86_64 23/35 2024-09-18T12:55:20.048 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:19.3.0-4931.g090e6509.el9.x86_64 23/35 2024-09-18T12:55:20.087 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rbd-2:19.3.0-4931.g090e6509.el9.x86_64 24/35 2024-09-18T12:55:20.122 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-18T12:55:20.708 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-18T12:55:20.734 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librgw2-2:19.3.0-4931.g090e6509.el9.x86_64 27/35 2024-09-18T12:55:20.806 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librgw2-2:19.3.0-4931.g090e6509.el9.x86_64 27/35 2024-09-18T12:55:20.884 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rgw-2:19.3.0-4931.g090e6509.el9.x86_64 28/35 2024-09-18T12:55:20.928 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-common-2:19.3.0-4931.g090e6509.el9.x8 29/35 2024-09-18T12:55:23.403 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 30/35 2024-09-18T12:55:23.433 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 30/35 2024-09-18T12:55:24.136 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 30/35 2024-09-18T12:55:24.169 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-base-2:19.3.0-4931.g090e6509.el9.x86_64 31/35 2024-09-18T12:55:24.260 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-base-2:19.3.0-4931.g090e6509.el9.x86_64 31/35 2024-09-18T12:55:24.260 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T12:55:24.260 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T12:55:24.260 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:55:24.287 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-selinux-2:19.3.0-4931.g090e6509.el9.x86_64 32/35 2024-09-18T12:55:34.649 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4931.g090e6509.el9.x86_64 32/35 2024-09-18T12:55:34.650 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /sys 2024-09-18T12:55:34.650 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /proc 2024-09-18T12:55:34.650 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /mnt 2024-09-18T12:55:34.650 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /var/tmp 2024-09-18T12:55:34.650 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /home 2024-09-18T12:55:34.650 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /root 2024-09-18T12:55:34.650 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /tmp 2024-09-18T12:55:34.650 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:55:35.746 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-radosgw-2:19.3.0-4931.g090e6509.el9.x86_64 33/35 2024-09-18T12:55:35.771 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4931.g090e6509.el9.x86_64 33/35 2024-09-18T12:55:35.771 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:55:35.771 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T12:55:35.771 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:55:35.771 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:55:35.772 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:55:35.773 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-18T12:55:35.856 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-18T12:55:35.856 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-18T12:55:37.088 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-18T12:55:37.089 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-base-2:19.3.0-4931.g090e6509.el9.x86_64 1/35 2024-09-18T12:55:37.089 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 2/35 2024-09-18T12:55:37.089 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-radosgw-2:19.3.0-4931.g090e6509.el9.x86_64 3/35 2024-09-18T12:55:37.089 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-selinux-2:19.3.0-4931.g090e6509.el9.x86_64 4/35 2024-09-18T12:55:37.089 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs2-2:19.3.0-4931.g090e6509.el9.x86_64 5/35 2024-09-18T12:55:37.089 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libradosstriper1-2:19.3.0-4931.g090e6509.el9.x86_6 6/35 2024-09-18T12:55:37.089 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librgw2-2:19.3.0-4931.g090e6509.el9.x86_64 7/35 2024-09-18T12:55:37.089 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4931.g090e6509.el9. 8/35 2024-09-18T12:55:37.089 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-common-2:19.3.0-4931.g090e6509.el9.x8 9/35 2024-09-18T12:55:37.089 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cephfs-2:19.3.0-4931.g090e6509.el9.x86_64 10/35 2024-09-18T12:55:37.089 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rados-2:19.3.0-4931.g090e6509.el9.x86_64 11/35 2024-09-18T12:55:37.089 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rbd-2:19.3.0-4931.g090e6509.el9.x86_64 12/35 2024-09-18T12:55:37.089 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rgw-2:19.3.0-4931.g090e6509.el9.x86_64 13/35 2024-09-18T12:55:37.090 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-18T12:55:37.090 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-18T12:55:37.090 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-18T12:55:37.090 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-18T12:55:37.090 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-18T12:55:37.090 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-18T12:55:37.090 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-18T12:55:37.090 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-18T12:55:37.090 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-18T12:55:37.090 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-18T12:55:37.090 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-18T12:55:37.090 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-18T12:55:37.090 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-18T12:55:37.090 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-18T12:55:37.091 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-18T12:55:37.091 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-18T12:55:37.091 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-18T12:55:37.091 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-18T12:55:37.091 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:19.3.0-4931.g090e6509.el9.x86_64 32/35 2024-09-18T12:55:37.091 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-18T12:55:37.091 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:19.3.0-4931.g090e6509.el9.x86_64 34/35 2024-09-18T12:55:37.912 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-18T12:55:37.912 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:55:37.912 INFO:teuthology.orchestra.run.smithi178.stdout:Upgraded: 2024-09-18T12:55:37.912 INFO:teuthology.orchestra.run.smithi178.stdout: librados2-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:37.913 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:55:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-18T12:55:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T12:55:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-18T12:55:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-18T12:55:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-18T12:55:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T12:55:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T12:55:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T12:55:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T12:55:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T12:55:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T12:55:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-18T12:55:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T12:55:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:37.915 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:37.915 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:37.915 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-18T12:55:37.915 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-18T12:55:37.915 INFO:teuthology.orchestra.run.smithi178.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-18T12:55:37.915 INFO:teuthology.orchestra.run.smithi178.stdout: re2-1:20211101-20.el9.x86_64 2024-09-18T12:55:37.915 INFO:teuthology.orchestra.run.smithi178.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T12:55:37.915 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:55:37.915 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:55:38.253 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-test 2024-09-18T12:55:38.845 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:00:28 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:55:38.981 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:55:38.982 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:55:38.982 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-18T12:55:38.982 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:55:38.982 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:55:38.982 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test x86_64 2:19.3.0-4931.g090e6509.el9 ceph 81 M 2024-09-18T12:55:38.982 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-18T12:55:38.982 INFO:teuthology.orchestra.run.smithi178.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-18T12:55:38.982 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite x86_64 2:19.3.0-4931.g090e6509.el9 ceph 175 k 2024-09-18T12:55:38.982 INFO:teuthology.orchestra.run.smithi178.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-18T12:55:38.983 INFO:teuthology.orchestra.run.smithi178.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-18T12:55:38.983 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-18T12:55:38.983 INFO:teuthology.orchestra.run.smithi178.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T12:55:38.983 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T12:55:38.983 INFO:teuthology.orchestra.run.smithi178.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-18T12:55:38.983 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:55:38.983 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:55:38.983 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:55:38.983 INFO:teuthology.orchestra.run.smithi178.stdout:Install 9 Packages 2024-09-18T12:55:38.983 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:55:38.984 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 83 M 2024-09-18T12:55:38.984 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 775 M 2024-09-18T12:55:38.984 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:55:39.652 INFO:teuthology.orchestra.run.smithi178.stdout:(1/9): libcephsqlite-19.3.0-4931.g090e6509.el9. 815 kB/s | 175 kB 00:00 2024-09-18T12:55:40.085 INFO:teuthology.orchestra.run.smithi178.stdout:(2/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 145 kB/s | 94 kB 00:00 2024-09-18T12:55:40.394 INFO:teuthology.orchestra.run.smithi178.stdout:(3/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 699 kB/s | 513 kB 00:00 2024-09-18T12:55:40.636 INFO:teuthology.orchestra.run.smithi178.stdout:(4/9): libubsan-11.5.0-2.el9.x86_64.rpm 332 kB/s | 183 kB 00:00 2024-09-18T12:55:40.803 INFO:teuthology.orchestra.run.smithi178.stdout:(5/9): protobuf-3.14.0-13.el9.x86_64.rpm 2.5 MB/s | 1.0 MB 00:00 2024-09-18T12:55:40.911 INFO:teuthology.orchestra.run.smithi178.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 589 kB/s | 64 kB 00:00 2024-09-18T12:55:40.937 INFO:teuthology.orchestra.run.smithi178.stdout:(7/9): socat-1.7.4.1-6.el9.x86_64.rpm 1.0 MB/s | 304 kB 00:00 2024-09-18T12:55:40.987 INFO:teuthology.orchestra.run.smithi178.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.6 MB/s | 122 kB 00:00 2024-09-18T12:55:41.745 INFO:teuthology.orchestra.run.smithi178.stdout:(9/9): ceph-test-19.3.0-4931.g090e6509.el9.x86_ 35 MB/s | 81 MB 00:02 2024-09-18T12:55:41.748 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:55:41.748 INFO:teuthology.orchestra.run.smithi178.stdout:Total 30 MB/s | 83 MB 00:02 2024-09-18T12:55:41.833 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:55:41.855 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:55:41.855 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:55:42.432 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:55:42.432 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:55:43.287 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:55:43.356 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-18T12:55:43.405 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-18T12:55:43.449 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-18T12:55:43.498 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-18T12:55:43.533 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-18T12:55:43.557 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-18T12:55:43.631 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-18T12:55:43.674 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-18T12:55:43.700 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephsqlite-2:19.3.0-4931.g090e6509.el9.x86_64 8/9 2024-09-18T12:55:54.673 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4931.g090e6509.el9.x86_64 8/9 2024-09-18T12:55:54.757 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-test-2:19.3.0-4931.g090e6509.el9.x86_64 9/9 2024-09-18T12:56:00.837 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-test-2:19.3.0-4931.g090e6509.el9.x86_64 9/9 2024-09-18T12:56:00.837 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-test-2:19.3.0-4931.g090e6509.el9.x86_64 1/9 2024-09-18T12:56:00.837 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephsqlite-2:19.3.0-4931.g090e6509.el9.x86_64 2/9 2024-09-18T12:56:00.837 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-18T12:56:00.837 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-18T12:56:00.837 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-18T12:56:00.837 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-18T12:56:00.837 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-18T12:56:00.837 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-18T12:56:01.264 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-18T12:56:01.265 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:01.265 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:56:01.265 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:01.265 INFO:teuthology.orchestra.run.smithi178.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-18T12:56:01.265 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:01.265 INFO:teuthology.orchestra.run.smithi178.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-18T12:56:01.265 INFO:teuthology.orchestra.run.smithi178.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-18T12:56:01.265 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-18T12:56:01.265 INFO:teuthology.orchestra.run.smithi178.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-18T12:56:01.265 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T12:56:01.265 INFO:teuthology.orchestra.run.smithi178.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-18T12:56:01.266 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:01.266 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:56:01.618 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph 2024-09-18T12:56:02.197 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:00:52 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:56:02.339 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:56:02.342 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:56:02.342 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-18T12:56:02.342 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:56:02.342 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:56:02.342 INFO:teuthology.orchestra.run.smithi178.stdout: ceph x86_64 2:19.3.0-4931.g090e6509.el9 ceph 6.5 k 2024-09-18T12:56:02.342 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-18T12:56:02.342 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds x86_64 2:19.3.0-4931.g090e6509.el9 ceph 2.2 M 2024-09-18T12:56:02.342 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr x86_64 2:19.3.0-4931.g090e6509.el9 ceph 1.6 M 2024-09-18T12:56:02.342 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 291 k 2024-09-18T12:56:02.342 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon x86_64 2:19.3.0-4931.g090e6509.el9 ceph 5.1 M 2024-09-18T12:56:02.342 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd x86_64 2:19.3.0-4931.g090e6509.el9 ceph 70 M 2024-09-18T12:56:02.343 INFO:teuthology.orchestra.run.smithi178.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-18T12:56:02.343 INFO:teuthology.orchestra.run.smithi178.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-18T12:56:02.343 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-18T12:56:02.343 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T12:56:02.343 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T12:56:02.343 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T12:56:02.343 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T12:56:02.343 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T12:56:02.343 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T12:56:02.343 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T12:56:02.343 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-collections 2024-09-18T12:56:02.344 INFO:teuthology.orchestra.run.smithi178.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-18T12:56:02.344 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T12:56:02.344 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T12:56:02.344 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T12:56:02.344 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T12:56:02.344 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T12:56:02.344 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T12:56:02.344 INFO:teuthology.orchestra.run.smithi178.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T12:56:02.344 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T12:56:02.344 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T12:56:02.344 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T12:56:02.344 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T12:56:02.345 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T12:56:02.345 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T12:56:02.345 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T12:56:02.345 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T12:56:02.345 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T12:56:02.345 INFO:teuthology.orchestra.run.smithi178.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T12:56:02.345 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T12:56:02.345 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T12:56:02.345 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T12:56:02.345 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:02.345 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:56:02.345 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:56:02.346 INFO:teuthology.orchestra.run.smithi178.stdout:Install 37 Packages 2024-09-18T12:56:02.346 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:02.346 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 84 M 2024-09-18T12:56:02.346 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 896 M 2024-09-18T12:56:02.346 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:56:03.141 INFO:teuthology.orchestra.run.smithi178.stdout:(1/37): ceph-19.3.0-4931.g090e6509.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-18T12:56:03.349 INFO:teuthology.orchestra.run.smithi178.stdout:(2/37): ceph-mds-19.3.0-4931.g090e6509.el9.x86_ 6.5 MB/s | 2.2 MB 00:00 2024-09-18T12:56:03.395 INFO:teuthology.orchestra.run.smithi178.stdout:(3/37): ceph-mgr-19.3.0-4931.g090e6509.el9.x86_ 4.2 MB/s | 1.6 MB 00:00 2024-09-18T12:56:03.495 INFO:teuthology.orchestra.run.smithi178.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4931.g090e 2.8 MB/s | 291 kB 00:00 2024-09-18T12:56:03.587 INFO:teuthology.orchestra.run.smithi178.stdout:(5/37): ceph-mon-19.3.0-4931.g090e6509.el9.x86_ 11 MB/s | 5.1 MB 00:00 2024-09-18T12:56:03.704 INFO:teuthology.orchestra.run.smithi178.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-18T12:56:03.746 INFO:teuthology.orchestra.run.smithi178.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-18T12:56:03.788 INFO:teuthology.orchestra.run.smithi178.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-18T12:56:03.830 INFO:teuthology.orchestra.run.smithi178.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-09-18T12:56:03.872 INFO:teuthology.orchestra.run.smithi178.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 5.0 MB/s | 215 kB 00:00 2024-09-18T12:56:03.914 INFO:teuthology.orchestra.run.smithi178.stdout:(11/37): python3-cryptography-36.0.1-4.el9.x86_ 3.8 MB/s | 1.2 MB 00:00 2024-09-18T12:56:04.455 INFO:teuthology.orchestra.run.smithi178.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 323 kB/s | 188 kB 00:00 2024-09-18T12:56:04.481 INFO:teuthology.orchestra.run.smithi178.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 304 kB/s | 172 kB 00:00 2024-09-18T12:56:04.556 INFO:teuthology.orchestra.run.smithi178.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 346 kB/s | 35 kB 00:00 2024-09-18T12:56:04.589 INFO:teuthology.orchestra.run.smithi178.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 711 kB/s | 77 kB 00:00 2024-09-18T12:56:04.673 INFO:teuthology.orchestra.run.smithi178.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 436 kB/s | 51 kB 00:00 2024-09-18T12:56:04.690 INFO:teuthology.orchestra.run.smithi178.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-18T12:56:04.740 INFO:teuthology.orchestra.run.smithi178.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-18T12:56:04.758 INFO:teuthology.orchestra.run.smithi178.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 265 kB/s | 22 kB 00:00 2024-09-18T12:56:04.774 INFO:teuthology.orchestra.run.smithi178.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.3 MB/s | 43 kB 00:00 2024-09-18T12:56:05.425 INFO:teuthology.orchestra.run.smithi178.stdout:(21/37): ceph-osd-19.3.0-4931.g090e6509.el9.x86 34 MB/s | 70 MB 00:02 2024-09-18T12:56:05.467 INFO:teuthology.orchestra.run.smithi178.stdout:(22/37): python3-cherrypy-18.6.1-2.el9.noarch.r 523 kB/s | 358 kB 00:00 2024-09-18T12:56:05.492 INFO:teuthology.orchestra.run.smithi178.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 234 kB/s | 172 kB 00:00 2024-09-18T12:56:05.509 INFO:teuthology.orchestra.run.smithi178.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 131 kB/s | 11 kB 00:00 2024-09-18T12:56:05.526 INFO:teuthology.orchestra.run.smithi178.stdout:(25/37): python3-jaraco-classes-3.2.1-5.el9.noa 310 kB/s | 18 kB 00:00 2024-09-18T12:56:05.543 INFO:teuthology.orchestra.run.smithi178.stdout:(26/37): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-18T12:56:05.560 INFO:teuthology.orchestra.run.smithi178.stdout:(27/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-18T12:56:05.577 INFO:teuthology.orchestra.run.smithi178.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-18T12:56:05.593 INFO:teuthology.orchestra.run.smithi178.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2024-09-18T12:56:05.619 INFO:teuthology.orchestra.run.smithi178.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-09-18T12:56:05.636 INFO:teuthology.orchestra.run.smithi178.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 392 kB/s | 16 kB 00:00 2024-09-18T12:56:05.661 INFO:teuthology.orchestra.run.smithi178.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-18T12:56:05.686 INFO:teuthology.orchestra.run.smithi178.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-09-18T12:56:05.711 INFO:teuthology.orchestra.run.smithi178.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-18T12:56:05.737 INFO:teuthology.orchestra.run.smithi178.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 803 kB/s | 20 kB 00:00 2024-09-18T12:56:05.762 INFO:teuthology.orchestra.run.smithi178.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-18T12:56:05.787 INFO:teuthology.orchestra.run.smithi178.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-18T12:56:05.791 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:05.791 INFO:teuthology.orchestra.run.smithi178.stdout:Total 24 MB/s | 84 MB 00:03 2024-09-18T12:56:05.942 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:56:05.984 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:56:05.985 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:56:06.769 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:56:06.769 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:56:08.432 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:56:08.498 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-18T12:56:08.531 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-18T12:56:08.558 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-18T12:56:08.629 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-18T12:56:08.699 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-18T12:56:08.732 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-18T12:56:08.823 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-18T12:56:08.902 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-18T12:56:08.943 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-18T12:56:08.978 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-18T12:56:09.007 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-18T12:56:09.042 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-18T12:56:09.078 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-18T12:56:09.116 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-18T12:56:09.150 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-18T12:56:09.185 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-18T12:56:09.233 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-18T12:56:09.266 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-18T12:56:09.338 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-18T12:56:09.486 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-18T12:56:09.565 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-18T12:56:09.619 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-18T12:56:09.673 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-18T12:56:09.722 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-18T12:56:09.777 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-18T12:56:09.973 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-18T12:56:10.019 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-18T12:56:10.096 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-18T12:56:10.184 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-18T12:56:10.218 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-18T12:56:10.355 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-18T12:56:10.553 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4931.g090e6509.el9. 32/37 2024-09-18T12:56:10.578 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-2:19.3.0-4931.g090e6509.el9.x86_64 33/37 2024-09-18T12:56:10.604 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4931.g090e6509.el9.x86_64 33/37 2024-09-18T12:56:10.604 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:56:10.605 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T12:56:10.605 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:56:10.605 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:56:10.605 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:21.128 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-osd-2:19.3.0-4931.g090e6509.el9.x86_64 34/37 2024-09-18T12:56:21.155 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-osd-2:19.3.0-4931.g090e6509.el9.x86_64 34/37 2024-09-18T12:56:21.155 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:56:21.155 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T12:56:21.155 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:56:21.156 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:56:21.156 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:21.695 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mon-2:19.3.0-4931.g090e6509.el9.x86_64 35/37 2024-09-18T12:56:21.719 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mon-2:19.3.0-4931.g090e6509.el9.x86_64 35/37 2024-09-18T12:56:21.719 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:56:21.719 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T12:56:21.720 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:56:21.720 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:56:21.720 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:21.954 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mds-2:19.3.0-4931.g090e6509.el9.x86_64 36/37 2024-09-18T12:56:21.978 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mds-2:19.3.0-4931.g090e6509.el9.x86_64 36/37 2024-09-18T12:56:21.978 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:56:21.978 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T12:56:21.978 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:56:21.978 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:56:21.978 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:22.042 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-2:19.3.0-4931.g090e6509.el9.x86_64 37/37 2024-09-18T12:56:28.713 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-2:19.3.0-4931.g090e6509.el9.x86_64 37/37 2024-09-18T12:56:28.714 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-2:19.3.0-4931.g090e6509.el9.x86_64 1/37 2024-09-18T12:56:28.714 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mds-2:19.3.0-4931.g090e6509.el9.x86_64 2/37 2024-09-18T12:56:28.714 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-2:19.3.0-4931.g090e6509.el9.x86_64 3/37 2024-09-18T12:56:28.714 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mon-2:19.3.0-4931.g090e6509.el9.x86_64 4/37 2024-09-18T12:56:28.714 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-osd-2:19.3.0-4931.g090e6509.el9.x86_64 5/37 2024-09-18T12:56:28.714 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4931.g090e6509.el9. 6/37 2024-09-18T12:56:28.714 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-18T12:56:28.714 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-18T12:56:28.714 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-18T12:56:28.715 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-18T12:56:28.715 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-18T12:56:28.715 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-18T12:56:28.715 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-18T12:56:28.715 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-18T12:56:28.715 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-18T12:56:28.715 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-18T12:56:28.715 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-18T12:56:28.715 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-18T12:56:28.715 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-18T12:56:28.715 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-18T12:56:28.715 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-18T12:56:28.716 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-18T12:56:28.716 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-18T12:56:28.716 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-18T12:56:28.716 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-18T12:56:28.716 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-18T12:56:28.716 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-18T12:56:28.716 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-18T12:56:28.716 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-18T12:56:28.717 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-18T12:56:28.717 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-18T12:56:28.717 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-18T12:56:28.717 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-18T12:56:28.717 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-18T12:56:28.717 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-18T12:56:28.718 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-18T12:56:29.827 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-18T12:56:29.827 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:29.827 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:56:29.827 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:29.827 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:29.827 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:29.827 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:29.827 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:29.827 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:29.827 INFO:teuthology.orchestra.run.smithi178.stdout: lua-5.4.4-4.el9.x86_64 2024-09-18T12:56:29.828 INFO:teuthology.orchestra.run.smithi178.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-18T12:56:29.828 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-18T12:56:29.828 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T12:56:29.828 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T12:56:29.828 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T12:56:29.828 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T12:56:29.828 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T12:56:29.828 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T12:56:29.828 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T12:56:29.828 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T12:56:29.828 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T12:56:29.828 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T12:56:29.829 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T12:56:29.829 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T12:56:29.829 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T12:56:29.829 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T12:56:29.829 INFO:teuthology.orchestra.run.smithi178.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T12:56:29.829 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T12:56:29.829 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T12:56:29.829 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T12:56:29.829 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T12:56:29.829 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T12:56:29.829 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T12:56:29.829 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T12:56:29.829 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T12:56:29.829 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T12:56:29.830 INFO:teuthology.orchestra.run.smithi178.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T12:56:29.830 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T12:56:29.830 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T12:56:29.830 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T12:56:29.830 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:29.830 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:56:30.113 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-base 2024-09-18T12:56:30.695 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:20 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:56:30.787 INFO:teuthology.orchestra.run.smithi178.stdout:Package ceph-base-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:30.830 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:56:30.831 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-18T12:56:30.831 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:56:30.901 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install cephadm 2024-09-18T12:56:31.478 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:21 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:56:31.610 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:56:31.611 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:56:31.611 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-18T12:56:31.612 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:56:31.612 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:56:31.612 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 784 k 2024-09-18T12:56:31.612 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:31.612 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:56:31.612 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:56:31.612 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-18T12:56:31.612 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:31.612 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 784 k 2024-09-18T12:56:31.613 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 791 k 2024-09-18T12:56:31.613 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:56:31.880 INFO:teuthology.orchestra.run.smithi178.stdout:cephadm-19.3.0-4931.g090e6509.el9.noarch.rpm 2.9 MB/s | 784 kB 00:00 2024-09-18T12:56:31.881 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:31.881 INFO:teuthology.orchestra.run.smithi178.stdout:Total 2.8 MB/s | 784 kB 00:00 2024-09-18T12:56:31.881 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:56:31.886 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:56:31.886 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:56:31.892 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:56:31.892 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:56:31.965 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:56:32.409 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephadm-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:56:32.509 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephadm-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:56:32.872 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephadm-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:56:33.119 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephadm-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:56:33.120 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:33.120 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:56:33.120 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:33.120 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:33.120 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:56:33.360 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T12:56:33.954 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:23 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:56:34.093 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:56:34.093 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:56:34.093 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repo Size 2024-09-18T12:56:34.093 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:56:34.094 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:56:34.094 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4931.g090e6509.el9 ceph 158 k 2024-09-18T12:56:34.094 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:34.094 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:56:34.094 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:56:34.094 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-18T12:56:34.094 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:34.094 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 158 k 2024-09-18T12:56:34.094 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 644 k 2024-09-18T12:56:34.094 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:56:34.294 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-immutable-object-cache-19.3.0-4931.g090e65 795 kB/s | 158 kB 00:00 2024-09-18T12:56:34.294 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:34.294 INFO:teuthology.orchestra.run.smithi178.stdout:Total 788 kB/s | 158 kB 00:00 2024-09-18T12:56:34.295 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:56:34.304 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:56:34.305 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:56:34.363 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:56:34.363 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:56:34.510 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:56:34.569 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4931.g090e6509. 1/1 2024-09-18T12:56:34.595 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4931.g090e6509. 1/1 2024-09-18T12:56:34.595 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:56:34.596 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T12:56:34.596 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:35.579 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4931.g090e6509. 1/1 2024-09-18T12:56:35.580 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:35.580 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:56:35.580 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:35.580 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:35.580 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:56:35.810 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-mgr 2024-09-18T12:56:36.398 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:26 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:56:36.490 INFO:teuthology.orchestra.run.smithi178.stdout:Package ceph-mgr-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:36.532 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:56:36.533 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-18T12:56:36.533 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:56:36.602 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T12:56:37.187 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:27 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:56:37.319 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:56:37.320 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:56:37.320 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-18T12:56:37.320 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:56:37.321 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:56:37.321 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 14 M 2024-09-18T12:56:37.321 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-18T12:56:37.321 INFO:teuthology.orchestra.run.smithi178.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-18T12:56:37.321 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 34 k 2024-09-18T12:56:37.321 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 16 k 2024-09-18T12:56:37.321 INFO:teuthology.orchestra.run.smithi178.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-18T12:56:37.321 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-18T12:56:37.321 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-18T12:56:37.321 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-18T12:56:37.321 INFO:teuthology.orchestra.run.smithi178.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-18T12:56:37.322 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T12:56:37.322 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T12:56:37.322 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:37.322 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:56:37.322 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:56:37.322 INFO:teuthology.orchestra.run.smithi178.stdout:Install 11 Packages 2024-09-18T12:56:37.322 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:37.322 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 18 M 2024-09-18T12:56:37.323 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 155 M 2024-09-18T12:56:37.323 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:56:37.797 INFO:teuthology.orchestra.run.smithi178.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4931.g09 217 kB/s | 34 kB 00:00 2024-09-18T12:56:37.822 INFO:teuthology.orchestra.run.smithi178.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4931.g090 90 kB/s | 16 kB 00:00 2024-09-18T12:56:37.997 INFO:teuthology.orchestra.run.smithi178.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 4.8 MB/s | 863 kB 00:00 2024-09-18T12:56:38.023 INFO:teuthology.orchestra.run.smithi178.stdout:(4/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.2 MB/s | 269 kB 00:00 2024-09-18T12:56:38.065 INFO:teuthology.orchestra.run.smithi178.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 468 kB/s | 19 kB 00:00 2024-09-18T12:56:38.132 INFO:teuthology.orchestra.run.smithi178.stdout:(6/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.0 MB/s | 548 kB 00:00 2024-09-18T12:56:38.165 INFO:teuthology.orchestra.run.smithi178.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.3 MB/s | 144 kB 00:00 2024-09-18T12:56:38.191 INFO:teuthology.orchestra.run.smithi178.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-18T12:56:38.225 INFO:teuthology.orchestra.run.smithi178.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-18T12:56:38.383 INFO:teuthology.orchestra.run.smithi178.stdout:(10/11): ceph-mgr-dashboard-19.3.0-4931.g090e65 19 MB/s | 14 MB 00:00 2024-09-18T12:56:38.425 INFO:teuthology.orchestra.run.smithi178.stdout:(11/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.7 MB/s | 2.0 MB 00:00 2024-09-18T12:56:38.428 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:38.429 INFO:teuthology.orchestra.run.smithi178.stdout:Total 16 MB/s | 18 MB 00:01 2024-09-18T12:56:38.459 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:56:38.478 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:56:38.478 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:56:38.753 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:56:38.753 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:56:39.304 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:56:39.390 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-18T12:56:39.428 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-18T12:56:39.529 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-18T12:56:39.663 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-18T12:56:39.714 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-18T12:56:39.799 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-18T12:56:39.842 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-18T12:56:39.870 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-18T12:56:39.902 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4931.g090e6509.el9 9/11 2024-09-18T12:56:43.096 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4931.g090e6509.el 10/11 2024-09-18T12:56:43.157 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4931.g090e6509.el9.noa 11/11 2024-09-18T12:56:45.077 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4931.g090e6509.el9.noa 11/11 2024-09-18T12:56:45.077 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4931.g090e6509.el 1/11 2024-09-18T12:56:45.078 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4931.g090e6509.el9.noa 2/11 2024-09-18T12:56:45.078 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4931.g090e6509.el9 3/11 2024-09-18T12:56:45.078 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-18T12:56:45.078 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-18T12:56:45.078 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-18T12:56:45.078 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-18T12:56:45.078 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-18T12:56:45.078 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-18T12:56:45.078 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-18T12:56:45.383 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-18T12:56:45.383 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:45.383 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:56:45.383 INFO:teuthology.orchestra.run.smithi178.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-18T12:56:45.383 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:45.383 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:45.383 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:45.383 INFO:teuthology.orchestra.run.smithi178.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-18T12:56:45.383 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-18T12:56:45.383 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-18T12:56:45.383 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-18T12:56:45.384 INFO:teuthology.orchestra.run.smithi178.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-18T12:56:45.384 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T12:56:45.384 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T12:56:45.384 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:45.384 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:56:45.651 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T12:56:46.233 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:56:46.368 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:56:46.370 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2024-09-18T12:56:46.370 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-18T12:56:46.370 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2024-09-18T12:56:46.370 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:56:46.370 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 7.4 M 2024-09-18T12:56:46.370 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-18T12:56:46.370 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T12:56:46.370 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T12:56:46.371 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T12:56:46.371 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T12:56:46.371 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T12:56:46.371 INFO:teuthology.orchestra.run.smithi178.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T12:56:46.371 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T12:56:46.371 INFO:teuthology.orchestra.run.smithi178.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T12:56:46.371 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T12:56:46.371 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T12:56:46.371 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T12:56:46.371 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:46.371 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:56:46.371 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2024-09-18T12:56:46.371 INFO:teuthology.orchestra.run.smithi178.stdout:Install 12 Packages 2024-09-18T12:56:46.372 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:46.372 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 38 M 2024-09-18T12:56:46.372 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 212 M 2024-09-18T12:56:46.372 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:56:46.996 INFO:teuthology.orchestra.run.smithi178.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 870 kB/s | 191 kB 00:00 2024-09-18T12:56:47.080 INFO:teuthology.orchestra.run.smithi178.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-18T12:56:47.114 INFO:teuthology.orchestra.run.smithi178.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-18T12:56:47.247 INFO:teuthology.orchestra.run.smithi178.stdout:(4/12): ceph-mgr-diskprediction-local-19.3.0-49 16 MB/s | 7.4 MB 00:00 2024-09-18T12:56:47.272 INFO:teuthology.orchestra.run.smithi178.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 115 kB/s | 18 kB 00:00 2024-09-18T12:56:47.389 INFO:teuthology.orchestra.run.smithi178.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 271 kB/s | 38 kB 00:00 2024-09-18T12:56:47.532 INFO:teuthology.orchestra.run.smithi178.stdout:(7/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 19 MB/s | 4.9 MB 00:00 2024-09-18T12:56:47.556 INFO:teuthology.orchestra.run.smithi178.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-18T12:56:47.632 INFO:teuthology.orchestra.run.smithi178.stdout:(9/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.4 MB/s | 3.0 MB 00:00 2024-09-18T12:56:47.657 INFO:teuthology.orchestra.run.smithi178.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.4 MB/s | 250 kB 00:00 2024-09-18T12:56:47.749 INFO:teuthology.orchestra.run.smithi178.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-18T12:56:48.266 INFO:teuthology.orchestra.run.smithi178.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-18T12:56:48.267 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:48.268 INFO:teuthology.orchestra.run.smithi178.stdout:Total 20 MB/s | 38 MB 00:01 2024-09-18T12:56:48.630 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:56:48.656 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:56:48.656 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:56:49.098 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:56:49.098 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:56:49.858 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:56:49.925 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T12:56:49.963 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:56:50.072 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:56:50.123 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T12:56:50.306 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T12:56:50.339 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T12:56:50.415 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T12:56:51.071 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T12:56:51.194 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T12:56:52.423 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:56:53.467 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T12:56:53.496 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4931.g090e6 12/12 2024-09-18T12:56:56.174 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4931.g090e6 12/12 2024-09-18T12:56:56.174 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4931.g090e6 1/12 2024-09-18T12:56:56.175 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:56:56.175 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:56:56.175 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T12:56:56.175 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T12:56:56.175 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T12:56:56.175 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T12:56:56.175 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T12:56:56.175 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T12:56:56.175 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:56:56.175 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T12:56:56.575 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T12:56:56.575 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:56.576 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:56:56.576 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:56.576 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T12:56:56.576 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T12:56:56.576 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T12:56:56.576 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T12:56:56.576 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T12:56:56.576 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T12:56:56.576 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T12:56:56.576 INFO:teuthology.orchestra.run.smithi178.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T12:56:56.576 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T12:56:56.577 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T12:56:56.577 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T12:56:56.577 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:56.577 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:56:56.957 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-mgr-rook 2024-09-18T12:56:57.549 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:47 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:56:57.682 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:56:57.683 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:56:57.683 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-18T12:56:57.684 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:56:57.684 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:56:57.684 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 49 k 2024-09-18T12:56:57.684 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-18T12:56:57.684 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T12:56:57.684 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T12:56:57.684 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T12:56:57.684 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T12:56:57.684 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T12:56:57.684 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T12:56:57.685 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T12:56:57.685 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T12:56:57.685 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T12:56:57.685 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T12:56:57.685 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T12:56:57.685 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T12:56:57.685 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:57.685 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:56:57.685 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:56:57.685 INFO:teuthology.orchestra.run.smithi178.stdout:Install 13 Packages 2024-09-18T12:56:57.685 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:56:57.686 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 2.2 M 2024-09-18T12:56:57.686 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 26 M 2024-09-18T12:56:57.686 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:56:58.463 INFO:teuthology.orchestra.run.smithi178.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 216 kB/s | 26 kB 00:00 2024-09-18T12:56:58.489 INFO:teuthology.orchestra.run.smithi178.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 133 kB/s | 19 kB 00:00 2024-09-18T12:56:58.514 INFO:teuthology.orchestra.run.smithi178.stdout:(3/13): ceph-mgr-rook-19.3.0-4931.g090e6509.el9 291 kB/s | 49 kB 00:00 2024-09-18T12:56:58.606 INFO:teuthology.orchestra.run.smithi178.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.9 MB/s | 222 kB 00:00 2024-09-18T12:56:58.631 INFO:teuthology.orchestra.run.smithi178.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-18T12:56:58.648 INFO:teuthology.orchestra.run.smithi178.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.2 MB/s | 54 kB 00:00 2024-09-18T12:56:58.698 INFO:teuthology.orchestra.run.smithi178.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-18T12:56:58.724 INFO:teuthology.orchestra.run.smithi178.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.3 MB/s | 279 kB 00:00 2024-09-18T12:56:58.741 INFO:teuthology.orchestra.run.smithi178.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 153 kB/s | 14 kB 00:00 2024-09-18T12:56:58.766 INFO:teuthology.orchestra.run.smithi178.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 3.3 MB/s | 59 kB 00:00 2024-09-18T12:56:58.791 INFO:teuthology.orchestra.run.smithi178.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-09-18T12:56:58.816 INFO:teuthology.orchestra.run.smithi178.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-18T12:56:58.891 INFO:teuthology.orchestra.run.smithi178.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.1 MB/s | 1.0 MB 00:00 2024-09-18T12:56:58.894 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:58.895 INFO:teuthology.orchestra.run.smithi178.stdout:Total 1.8 MB/s | 2.2 MB 00:01 2024-09-18T12:56:58.966 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:56:58.982 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:56:58.982 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:56:59.073 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:56:59.074 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:56:59.581 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:56:59.746 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T12:56:59.800 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T12:56:59.856 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T12:56:59.893 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T12:56:59.934 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T12:57:00.036 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T12:57:00.137 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T12:57:00.186 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T12:57:00.901 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T12:57:00.958 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T12:57:00.992 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T12:57:01.040 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T12:57:01.070 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-rook-2:19.3.0-4931.g090e6509.el9.noarch 13/13 2024-09-18T12:57:01.825 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4931.g090e6509.el9.noarch 13/13 2024-09-18T12:57:01.825 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4931.g090e6509.el9.noarch 1/13 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T12:57:02.171 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T12:57:02.172 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:02.172 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:57:02.172 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:57:02.172 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T12:57:02.172 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T12:57:02.172 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T12:57:02.172 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T12:57:02.172 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T12:57:02.172 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T12:57:02.172 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T12:57:02.172 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T12:57:02.172 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T12:57:02.173 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T12:57:02.173 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T12:57:02.173 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T12:57:02.173 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:02.173 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:02.447 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T12:57:03.037 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:53 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:57:03.171 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:57:03.171 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:03.171 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-18T12:57:03.171 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:03.172 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:57:03.172 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 154 k 2024-09-18T12:57:03.172 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-18T12:57:03.172 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T12:57:03.172 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T12:57:03.172 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T12:57:03.172 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T12:57:03.172 INFO:teuthology.orchestra.run.smithi178.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T12:57:03.172 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:03.172 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:57:03.172 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:03.172 INFO:teuthology.orchestra.run.smithi178.stdout:Install 6 Packages 2024-09-18T12:57:03.172 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:03.173 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 7.0 M 2024-09-18T12:57:03.173 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 33 M 2024-09-18T12:57:03.173 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:57:03.709 INFO:teuthology.orchestra.run.smithi178.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4931.g090e6509.e 698 kB/s | 154 kB 00:00 2024-09-18T12:57:03.909 INFO:teuthology.orchestra.run.smithi178.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.9 MB/s | 548 kB 00:00 2024-09-18T12:57:03.951 INFO:teuthology.orchestra.run.smithi178.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.4 MB/s | 58 kB 00:00 2024-09-18T12:57:03.993 INFO:teuthology.orchestra.run.smithi178.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 1.7 MB/s | 74 kB 00:00 2024-09-18T12:57:04.277 INFO:teuthology.orchestra.run.smithi178.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 315 kB/s | 248 kB 00:00 2024-09-18T12:57:04.652 INFO:teuthology.orchestra.run.smithi178.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-18T12:57:04.654 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:57:04.654 INFO:teuthology.orchestra.run.smithi178.stdout:Total 4.7 MB/s | 7.0 MB 00:01 2024-09-18T12:57:04.727 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:57:04.739 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:57:04.739 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:57:04.840 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:57:04.841 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:57:05.167 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:57:05.352 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T12:57:05.404 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T12:57:05.937 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T12:57:06.024 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T12:57:06.091 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T12:57:06.116 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4931.g090e6509.el9.noarch 6/6 2024-09-18T12:57:06.914 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4931.g090e6509.el9.noarch 6/6 2024-09-18T12:57:06.915 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4931.g090e6509.el9.noarch 1/6 2024-09-18T12:57:06.915 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T12:57:06.915 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T12:57:06.915 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T12:57:06.915 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T12:57:07.196 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T12:57:07.196 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:07.196 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:57:07.197 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:57:07.197 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T12:57:07.197 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T12:57:07.197 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T12:57:07.197 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T12:57:07.197 INFO:teuthology.orchestra.run.smithi178.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T12:57:07.197 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:07.197 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:07.470 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-fuse 2024-09-18T12:57:08.053 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:58 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:57:08.187 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:57:08.188 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:08.188 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-18T12:57:08.188 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:08.188 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:57:08.188 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse x86_64 2:19.3.0-4931.g090e6509.el9 ceph 884 k 2024-09-18T12:57:08.188 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-18T12:57:08.188 INFO:teuthology.orchestra.run.smithi178.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T12:57:08.188 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:08.188 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:57:08.188 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:08.188 INFO:teuthology.orchestra.run.smithi178.stdout:Install 2 Packages 2024-09-18T12:57:08.188 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:08.189 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 963 k 2024-09-18T12:57:08.189 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 4.1 M 2024-09-18T12:57:08.189 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:57:08.603 INFO:teuthology.orchestra.run.smithi178.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 579 kB/s | 80 kB 00:00 2024-09-18T12:57:08.745 INFO:teuthology.orchestra.run.smithi178.stdout:(2/2): ceph-fuse-19.3.0-4931.g090e6509.el9.x86_ 3.1 MB/s | 884 kB 00:00 2024-09-18T12:57:08.746 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:57:08.746 INFO:teuthology.orchestra.run.smithi178.stdout:Total 1.7 MB/s | 963 kB 00:00 2024-09-18T12:57:08.757 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:57:08.781 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:57:08.781 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:57:08.862 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:57:08.862 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:57:09.047 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:57:09.199 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T12:57:09.269 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 2/2 2024-09-18T12:57:09.979 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 2/2 2024-09-18T12:57:09.979 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 1/2 2024-09-18T12:57:10.241 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T12:57:10.242 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:10.242 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:57:10.242 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T12:57:10.242 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:10.242 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:10.512 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-volume 2024-09-18T12:57:11.113 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:01 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:57:11.253 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:57:11.253 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:11.254 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-18T12:57:11.254 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:11.254 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:57:11.254 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 285 k 2024-09-18T12:57:11.254 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:11.255 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:57:11.255 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:11.255 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-18T12:57:11.255 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:11.255 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 285 k 2024-09-18T12:57:11.256 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 1.3 M 2024-09-18T12:57:11.256 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:57:11.474 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-volume-19.3.0-4931.g090e6509.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-18T12:57:11.475 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:57:11.475 INFO:teuthology.orchestra.run.smithi178.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-18T12:57:11.475 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:57:11.484 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:57:11.484 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:57:11.512 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:57:11.513 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:57:11.731 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:57:11.810 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-volume-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:57:11.826 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-volume-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:57:11.826 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:57:11.826 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-18T12:57:11.827 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:12.880 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-volume-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:57:12.881 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:12.881 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:57:12.881 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:57:12.881 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:12.881 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:13.184 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install librados-devel 2024-09-18T12:57:13.787 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:03 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:57:13.919 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:57:13.920 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:13.920 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repo Size 2024-09-18T12:57:13.920 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:13.920 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:57:13.920 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel x86_64 2:19.3.0-4931.g090e6509.el9 ceph 125 k 2024-09-18T12:57:13.920 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:13.920 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:57:13.920 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:13.920 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-18T12:57:13.920 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:13.920 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 125 k 2024-09-18T12:57:13.921 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 445 k 2024-09-18T12:57:13.921 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:57:14.121 INFO:teuthology.orchestra.run.smithi178.stdout:librados-devel-19.3.0-4931.g090e6509.el9.x86_64 623 kB/s | 125 kB 00:00 2024-09-18T12:57:14.122 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:57:14.122 INFO:teuthology.orchestra.run.smithi178.stdout:Total 619 kB/s | 125 kB 00:00 2024-09-18T12:57:14.122 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:57:14.127 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:57:14.127 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:57:14.190 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:57:14.191 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:57:14.345 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:57:14.443 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librados-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:57:14.909 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:57:15.172 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:57:15.173 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:15.173 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:57:15.173 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:57:15.173 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:15.173 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:15.434 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install libcephfs2 2024-09-18T12:57:16.034 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:06 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:57:16.126 INFO:teuthology.orchestra.run.smithi178.stdout:Package libcephfs2-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:57:16.172 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:57:16.173 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-18T12:57:16.173 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:16.238 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install libcephfs-devel 2024-09-18T12:57:16.825 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:06 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:57:16.961 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:57:16.961 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:16.962 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repo Size 2024-09-18T12:57:16.962 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:16.962 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:57:16.962 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel x86_64 2:19.3.0-4931.g090e6509.el9 ceph 32 k 2024-09-18T12:57:16.962 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:16.962 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:57:16.962 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:16.962 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-18T12:57:16.962 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:16.962 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 32 k 2024-09-18T12:57:16.962 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 142 k 2024-09-18T12:57:16.962 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:57:17.123 INFO:teuthology.orchestra.run.smithi178.stdout:libcephfs-devel-19.3.0-4931.g090e6509.el9.x86_6 197 kB/s | 32 kB 00:00 2024-09-18T12:57:17.124 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:57:17.124 INFO:teuthology.orchestra.run.smithi178.stdout:Total 196 kB/s | 32 kB 00:00 2024-09-18T12:57:17.124 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:57:17.127 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:57:17.128 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:57:17.151 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:57:17.151 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:57:17.243 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:57:17.354 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:57:17.728 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:57:17.959 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:57:17.959 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:17.959 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:57:17.959 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:57:17.959 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:17.959 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:18.146 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install librados2 2024-09-18T12:57:18.726 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:08 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:57:18.816 INFO:teuthology.orchestra.run.smithi178.stdout:Package librados2-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:57:18.860 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:57:18.861 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-18T12:57:18.861 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:18.924 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install librbd1 2024-09-18T12:57:19.505 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:09 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:57:19.592 INFO:teuthology.orchestra.run.smithi178.stdout:Package librbd1-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:57:19.635 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:57:19.636 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-18T12:57:19.637 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:19.701 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install python3-rados 2024-09-18T12:57:20.290 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:10 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:57:20.379 INFO:teuthology.orchestra.run.smithi178.stdout:Package python3-rados-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:57:20.423 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:57:20.424 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-18T12:57:20.424 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:20.494 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install python3-rgw 2024-09-18T12:57:21.157 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:11 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:57:21.248 INFO:teuthology.orchestra.run.smithi178.stdout:Package python3-rgw-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:57:21.292 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:57:21.293 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-18T12:57:21.293 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:21.356 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install python3-cephfs 2024-09-18T12:57:21.957 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:11 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:57:22.058 INFO:teuthology.orchestra.run.smithi178.stdout:Package python3-cephfs-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:57:22.102 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:57:22.103 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-18T12:57:22.103 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:22.166 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install python3-rbd 2024-09-18T12:57:22.752 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:12 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:57:22.841 INFO:teuthology.orchestra.run.smithi178.stdout:Package python3-rbd-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:57:22.885 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:57:22.886 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-18T12:57:22.886 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:22.948 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install rbd-fuse 2024-09-18T12:57:23.545 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:13 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:57:23.683 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:57:23.684 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:23.684 INFO:teuthology.orchestra.run.smithi178.stdout: Package Architecture Version Repository Size 2024-09-18T12:57:23.684 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:23.684 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:57:23.684 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse x86_64 2:19.3.0-4931.g090e6509.el9 ceph 91 k 2024-09-18T12:57:23.685 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:23.685 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:57:23.685 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:23.685 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-18T12:57:23.685 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:23.685 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 91 k 2024-09-18T12:57:23.685 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 321 k 2024-09-18T12:57:23.685 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:57:23.868 INFO:teuthology.orchestra.run.smithi178.stdout:rbd-fuse-19.3.0-4931.g090e6509.el9.x86_64.rpm 496 kB/s | 91 kB 00:00 2024-09-18T12:57:23.869 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:57:23.869 INFO:teuthology.orchestra.run.smithi178.stdout:Total 491 kB/s | 91 kB 00:00 2024-09-18T12:57:23.869 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:57:23.878 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:57:23.878 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:57:23.945 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:57:23.945 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:57:24.093 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:57:24.200 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:57:24.622 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:57:24.901 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:57:24.901 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:24.902 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:57:24.902 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:57:24.902 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:24.902 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:25.138 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install rbd-mirror 2024-09-18T12:57:25.742 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:15 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:57:25.881 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:57:25.882 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:25.882 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repo Size 2024-09-18T12:57:25.882 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:25.882 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:57:25.882 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror x86_64 2:19.3.0-4931.g090e6509.el9 ceph 3.5 M 2024-09-18T12:57:25.882 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:25.882 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:57:25.882 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:25.882 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-18T12:57:25.882 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:25.882 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 3.5 M 2024-09-18T12:57:25.882 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 30 M 2024-09-18T12:57:25.883 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:57:27.005 INFO:teuthology.orchestra.run.smithi178.stdout:rbd-mirror-19.3.0-4931.g090e6509.el9.x86_64.rpm 3.1 MB/s | 3.5 MB 00:01 2024-09-18T12:57:27.005 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:57:27.006 INFO:teuthology.orchestra.run.smithi178.stdout:Total 3.1 MB/s | 3.5 MB 00:01 2024-09-18T12:57:27.006 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:57:27.018 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:57:27.018 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:57:27.104 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:57:27.104 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:57:27.692 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:57:27.755 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-mirror-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:57:27.782 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:57:27.782 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:57:27.782 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T12:57:27.782 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:57:27.782 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:57:27.782 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:29.094 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-mirror-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:57:29.094 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:29.094 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:57:29.095 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:57:29.095 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:29.095 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:29.325 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install rbd-nbd 2024-09-18T12:57:29.927 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:19 ago on Wed 18 Sep 2024 12:55:10 PM UTC. 2024-09-18T12:57:30.059 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-18T12:57:30.060 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:30.060 INFO:teuthology.orchestra.run.smithi178.stdout: Package Architecture Version Repository Size 2024-09-18T12:57:30.060 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:30.060 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-18T12:57:30.060 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd x86_64 2:19.3.0-4931.g090e6509.el9 ceph 177 k 2024-09-18T12:57:30.061 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:30.061 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-18T12:57:30.061 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-18T12:57:30.061 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-18T12:57:30.061 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:30.061 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 177 k 2024-09-18T12:57:30.061 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 685 k 2024-09-18T12:57:30.061 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-18T12:57:30.285 INFO:teuthology.orchestra.run.smithi178.stdout:rbd-nbd-19.3.0-4931.g090e6509.el9.x86_64.rpm 798 kB/s | 177 kB 00:00 2024-09-18T12:57:30.285 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:57:30.285 INFO:teuthology.orchestra.run.smithi178.stdout:Total 792 kB/s | 177 kB 00:00 2024-09-18T12:57:30.285 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-18T12:57:30.293 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-18T12:57:30.293 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-18T12:57:30.358 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-18T12:57:30.358 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-18T12:57:30.513 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-18T12:57:30.622 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-nbd-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:57:31.040 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:57:31.311 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-nbd-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:57:31.311 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:31.311 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-18T12:57:31.311 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:57:31.311 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:31.312 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-18T12:57:31.576 DEBUG:teuthology.parallel:result is None 2024-09-18T12:57:31.577 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=090e6509f8ae300193b1735deab951d46056ec88 2024-09-18T12:57:31.717 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T12:57:31.739 INFO:teuthology.orchestra.run.smithi178.stdout:19.3.0-4931.g090e6509.el9 2024-09-18T12:57:31.740 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4931.g090e6509.el9 2024-09-18T12:57:31.740 INFO:teuthology.task.install:The correct ceph version 19.3.0-4931.g090e6509 is installed. 2024-09-18T12:57:31.742 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-18T12:57:31.742 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:31.742 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T12:57:31.805 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-18T12:57:31.805 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:31.805 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T12:57:31.870 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T12:57:31.935 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-18T12:57:31.935 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:31.935 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T12:57:31.999 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T12:57:32.063 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-18T12:57:32.064 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:32.064 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T12:57:32.129 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T12:57:32.194 INFO:teuthology.run_tasks:Running task ceph... 2024-09-18T12:57:32.276 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-18T12:57:32.277 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /var/log/ceph 2024-09-18T12:57:32.319 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-18T12:57:32.319 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T12:57:32.385 INFO:tasks.ceph:Creating extra log directories... 2024-09-18T12:57:32.385 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T12:57:32.457 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-18T12:57:32.457 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(POOL_FULL\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-18T12:57:32.458 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911397', 'branch': 'main', 'description': 'crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7911397', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(POOL_FULL\\)'], 'sha1': '090e6509f8ae300193b1735deab951d46056ec88'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '090e6509f8ae300193b1735deab951d46056ec88'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_nmordech@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 2042, 'sha1': '090e6509f8ae300193b1735deab951d46056ec88', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi178.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHymDE/gns2lex+xzinywHiylHe1CwgrwZTAZIgBqGxLuFtTDE1JhfCFoVH/0FZ6haFKWnYoFMrVVA5SUiCYS9A='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(POOL_FULL\\)'], 'sha1': '090e6509f8ae300193b1735deab951d46056ec88', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rbd/crimson/test_crimson_librbd.sh']}, 'env': {'RBD_FEATURES': '61'}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-18_12:39:24', 'tube': 'smithi', 'user': 'nmordech', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-18T12:57:32.458 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T12:57:32.505 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T12:57:32.570 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:32.570 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T12:57:32.626 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T12:57:32.626 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2024-09-18T12:57:32.681 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T12:57:32.681 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:57:32.681 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-18T12:57:32.681 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:57:32.682 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:57:32.682 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-18 12:57:28.036172881 +0000 2024-09-18T12:57:32.682 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-18 12:54:33.730667424 +0000 2024-09-18T12:57:32.682 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-18 12:54:33.730667424 +0000 2024-09-18T12:57:32.682 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-18 12:54:33.730667424 +0000 2024-09-18T12:57:32.682 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T12:57:32.744 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-18T12:57:32.744 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-18T12:57:32.745 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 7.6928e-05 s, 6.7 MB/s 2024-09-18T12:57:32.745 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T12:57:32.802 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2024-09-18T12:57:32.858 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T12:57:32.858 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:57:32.858 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-18T12:57:32.858 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:57:32.858 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:57:32.858 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-18 12:57:28.036172881 +0000 2024-09-18T12:57:32.858 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-18 12:54:34.047661300 +0000 2024-09-18T12:57:32.858 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-18 12:54:34.047661300 +0000 2024-09-18T12:57:32.858 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-18 12:54:34.047661300 +0000 2024-09-18T12:57:32.859 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T12:57:32.922 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-18T12:57:32.922 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-18T12:57:32.922 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 9.1566e-05 s, 5.6 MB/s 2024-09-18T12:57:32.923 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T12:57:32.979 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2024-09-18T12:57:33.034 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T12:57:33.035 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:57:33.035 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-18T12:57:33.035 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:57:33.035 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:57:33.035 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-18 12:57:28.036172881 +0000 2024-09-18T12:57:33.035 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-18 12:54:34.378654906 +0000 2024-09-18T12:57:33.035 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-18 12:54:34.378654906 +0000 2024-09-18T12:57:33.035 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-18 12:54:34.378654906 +0000 2024-09-18T12:57:33.035 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T12:57:33.097 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-18T12:57:33.098 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-18T12:57:33.098 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000104208 s, 4.9 MB/s 2024-09-18T12:57:33.099 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T12:57:33.155 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2024-09-18T12:57:33.211 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T12:57:33.211 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:57:33.211 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-18T12:57:33.211 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:57:33.211 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:57:33.211 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-18 12:57:28.036172881 +0000 2024-09-18T12:57:33.211 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-18 12:54:34.690648879 +0000 2024-09-18T12:57:33.211 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-18 12:54:34.690648879 +0000 2024-09-18T12:57:33.212 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-18 12:54:34.690648879 +0000 2024-09-18T12:57:33.212 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T12:57:33.274 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-18T12:57:33.274 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-18T12:57:33.274 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 7.8735e-05 s, 6.5 MB/s 2024-09-18T12:57:33.276 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T12:57:33.332 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-18T12:57:33.332 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-18T12:57:33.333 INFO:tasks.ceph:Generating config... 2024-09-18T12:57:33.334 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-18T12:57:33.334 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-18T12:57:33.334 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-18T12:57:33.334 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-18T12:57:33.334 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-18T12:57:33.334 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-18T12:57:33.335 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-18T12:57:33.335 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-18T12:57:33.335 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-18T12:57:33.335 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-18T12:57:33.335 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-18T12:57:33.335 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-18T12:57:33.335 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-18T12:57:33.335 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-18T12:57:33.335 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-18T12:57:33.335 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-18T12:57:33.336 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-18T12:57:33.336 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-18T12:57:33.336 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-18T12:57:33.336 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-18T12:57:33.336 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-18T12:57:33.336 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-18T12:57:33.336 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-18T12:57:33.336 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-18T12:57:33.336 INFO:tasks.ceph:[osd] log to file = False 2024-09-18T12:57:33.336 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-18T12:57:33.336 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-18T12:57:33.337 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-18T12:57:33.337 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-18T12:57:33.337 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-18T12:57:33.337 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-18T12:57:33.337 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-18T12:57:33.337 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-18T12:57:33.337 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-18T12:57:33.337 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-18T12:57:33.337 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-18T12:57:33.337 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-18T12:57:33.338 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-18T12:57:33.338 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-18T12:57:33.338 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-18T12:57:33.338 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-18T12:57:33.338 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-18T12:57:33.338 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-1 2024-09-18T12:57:33.338 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 2-3 2024-09-18T12:57:33.338 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 4-5 2024-09-18T12:57:33.338 INFO:tasks.ceph:Setting up mon.a... 2024-09-18T12:57:33.339 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-18T12:57:33.429 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.keyring 2024-09-18T12:57:33.433 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-18T12:57:33.484 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T12:57:33.509 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.178')] 2024-09-18T12:57:33.509 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.178', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}} 2024-09-18T12:57:33.510 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:33.510 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T12:57:33.565 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.178 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:33.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:33.655+0000 7f53f8f22f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:33.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:33.655+0000 7f53f8f22f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:33.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:33.656+0000 7f53f8f22f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:33.657 INFO:teuthology.orchestra.run.smithi178.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:33.657 INFO:teuthology.orchestra.run.smithi178.stdout:monmaptool: generated fsid ef2e64fd-507f-40d9-bf22-5b28c8ab36ed 2024-09-18T12:57:33.657 INFO:teuthology.orchestra.run.smithi178.stdout:setting min_mon_release = quincy 2024-09-18T12:57:33.657 INFO:teuthology.orchestra.run.smithi178.stdout:epoch 0 2024-09-18T12:57:33.657 INFO:teuthology.orchestra.run.smithi178.stdout:fsid ef2e64fd-507f-40d9-bf22-5b28c8ab36ed 2024-09-18T12:57:33.657 INFO:teuthology.orchestra.run.smithi178.stdout:last_changed 2024-09-18T12:57:33.656612+0000 2024-09-18T12:57:33.657 INFO:teuthology.orchestra.run.smithi178.stdout:created 2024-09-18T12:57:33.656612+0000 2024-09-18T12:57:33.658 INFO:teuthology.orchestra.run.smithi178.stdout:min_mon_release 17 (quincy) 2024-09-18T12:57:33.658 INFO:teuthology.orchestra.run.smithi178.stdout:election_strategy: 1 2024-09-18T12:57:33.658 INFO:teuthology.orchestra.run.smithi178.stdout:0: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.a 2024-09-18T12:57:33.658 INFO:teuthology.orchestra.run.smithi178.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-18T12:57:33.659 DEBUG:teuthology.orchestra.run.smithi178:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T12:57:33.673 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ef2e64fd-507f-40d9-bf22-5b28c8ab36ed... 2024-09-18T12:57:33.674 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T12:57:33.756 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2024-09-18T12:57:33.756 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2024-09-18T12:57:33.756 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T12:57:33.757 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2024-09-18T12:57:33.757 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.757 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2024-09-18T12:57:33.757 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.757 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2024-09-18T12:57:33.757 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.757 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2024-09-18T12:57:33.757 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2024-09-18T12:57:33.757 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.757 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2024-09-18T12:57:33.757 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2024-09-18T12:57:33.757 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.757 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T12:57:33.757 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2024-09-18T12:57:33.758 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.758 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T12:57:33.758 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T12:57:33.758 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.758 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2024-09-18T12:57:33.758 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.758 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2024-09-18T12:57:33.758 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2024-09-18T12:57:33.758 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2024-09-18T12:57:33.758 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2024-09-18T12:57:33.758 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2024-09-18T12:57:33.758 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2024-09-18T12:57:33.758 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2024-09-18T12:57:33.758 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T12:57:33.759 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T12:57:33.759 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2024-09-18T12:57:33.759 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.759 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T12:57:33.759 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.759 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2024-09-18T12:57:33.759 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.759 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2024-09-18T12:57:33.759 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.759 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2024-09-18T12:57:33.759 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2024-09-18T12:57:33.759 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2024-09-18T12:57:33.759 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = 172.21.15.178 2024-09-18T12:57:33.760 INFO:teuthology.orchestra.run.smithi178.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-18T12:57:33.760 INFO:teuthology.orchestra.run.smithi178.stdout: ms client mode = crc 2024-09-18T12:57:33.760 INFO:teuthology.orchestra.run.smithi178.stdout: ms cluster mode = crc 2024-09-18T12:57:33.760 INFO:teuthology.orchestra.run.smithi178.stdout: ms mon client mode = crc 2024-09-18T12:57:33.760 INFO:teuthology.orchestra.run.smithi178.stdout: ms mon cluster mode = crc 2024-09-18T12:57:33.760 INFO:teuthology.orchestra.run.smithi178.stdout: ms mon service mode = crc 2024-09-18T12:57:33.760 INFO:teuthology.orchestra.run.smithi178.stdout: ms service mode = crc 2024-09-18T12:57:33.760 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = ef2e64fd-507f-40d9-bf22-5b28c8ab36ed 2024-09-18T12:57:33.760 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.760 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2024-09-18T12:57:33.760 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2024-09-18T12:57:33.760 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.760 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2024-09-18T12:57:33.760 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2024-09-18T12:57:33.761 INFO:teuthology.orchestra.run.smithi178.stdout: osd mclock profile = high_recovery_ops 2024-09-18T12:57:33.761 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.761 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2024-09-18T12:57:33.761 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2024-09-18T12:57:33.761 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.761 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2024-09-18T12:57:33.761 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2024-09-18T12:57:33.761 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2024-09-18T12:57:33.761 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug trim objects = true 2024-09-18T12:57:33.761 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.761 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2024-09-18T12:57:33.761 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2024-09-18T12:57:33.761 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.761 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2024-09-18T12:57:33.762 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.762 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2024-09-18T12:57:33.762 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.762 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2024-09-18T12:57:33.762 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.762 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2024-09-18T12:57:33.762 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2024-09-18T12:57:33.762 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.762 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2024-09-18T12:57:33.762 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2024-09-18T12:57:33.762 INFO:teuthology.orchestra.run.smithi178.stdout: debug monc = 20 2024-09-18T12:57:33.762 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2024-09-18T12:57:33.762 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore compression algorithm = snappy 2024-09-18T12:57:33.762 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore compression mode = aggressive 2024-09-18T12:57:33.762 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2024-09-18T12:57:33.763 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore rocksdb cf = False 2024-09-18T12:57:33.763 INFO:teuthology.orchestra.run.smithi178.stdout: crimson alien thread cpu cores = 6-7 2024-09-18T12:57:33.763 INFO:teuthology.orchestra.run.smithi178.stdout: crimson osd obc lru size = 10 2024-09-18T12:57:33.763 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 20 2024-09-18T12:57:33.763 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 20 2024-09-18T12:57:33.763 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-09-18T12:57:33.763 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2024-09-18T12:57:33.763 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 10 2024-09-18T12:57:33.763 INFO:teuthology.orchestra.run.smithi178.stdout: err to stderr = True 2024-09-18T12:57:33.763 INFO:teuthology.orchestra.run.smithi178.stdout: log flush on exit = True 2024-09-18T12:57:33.763 INFO:teuthology.orchestra.run.smithi178.stdout: log to file = False 2024-09-18T12:57:33.763 INFO:teuthology.orchestra.run.smithi178.stdout: log to stderr = True 2024-09-18T12:57:33.763 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T12:57:33.763 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2024-09-18T12:57:33.764 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2024-09-18T12:57:33.764 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2024-09-18T12:57:33.764 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2024-09-18T12:57:33.764 INFO:teuthology.orchestra.run.smithi178.stdout: osd shutdown pgref assert = True 2024-09-18T12:57:33.764 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.764 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2024-09-18T12:57:33.764 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-09-18T12:57:33.764 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2024-09-18T12:57:33.764 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-09-18T12:57:33.764 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-09-18T12:57:33.764 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-09-18T12:57:33.764 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-09-18T12:57:33.764 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2024-09-18T12:57:33.764 INFO:teuthology.orchestra.run.smithi178.stdout: mgr stats period = 30 2024-09-18T12:57:33.765 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.765 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2024-09-18T12:57:33.765 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-09-18T12:57:33.765 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-09-18T12:57:33.765 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2024-09-18T12:57:33.765 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-09-18T12:57:33.765 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2024-09-18T12:57:33.765 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2024-09-18T12:57:33.765 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-09-18T12:57:33.765 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2024-09-18T12:57:33.765 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2024-09-18T12:57:33.765 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-09-18T12:57:33.765 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.765 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T12:57:33.766 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T12:57:33.766 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T12:57:33.766 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.766 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T12:57:33.766 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T12:57:33.766 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T12:57:33.766 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.766 INFO:teuthology.orchestra.run.smithi178.stdout: # 1m isn't quite enough 2024-09-18T12:57:33.766 INFO:teuthology.orchestra.run.smithi178.stdout: mon_down_mkfs_grace = 2m 2024-09-18T12:57:33.766 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.766 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_filestore_osds = false 2024-09-18T12:57:33.766 INFO:teuthology.orchestra.run.smithi178.stdout: mon min osdmap epochs = 50 2024-09-18T12:57:33.766 INFO:teuthology.orchestra.run.smithi178.stdout: mon osdmap full prune interval = 2 2024-09-18T12:57:33.766 INFO:teuthology.orchestra.run.smithi178.stdout: mon osdmap full prune min = 15 2024-09-18T12:57:33.766 INFO:teuthology.orchestra.run.smithi178.stdout: mon osdmap full prune txsize = 2 2024-09-18T12:57:33.767 INFO:teuthology.orchestra.run.smithi178.stdout: paxos service trim min = 10 2024-09-18T12:57:33.767 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default crimson = True 2024-09-18T12:57:33.767 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:33.767 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2024-09-18T12:57:33.767 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2024-09-18T12:57:33.767 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2024-09-18T12:57:33.767 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2024-09-18T12:57:33.767 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T12:57:33.767 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T12:57:33.767 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2024-09-18T12:57:33.767 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.0] 2024-09-18T12:57:33.767 INFO:teuthology.orchestra.run.smithi178.stdout: crimson seastar cpu cores = 0-1 2024-09-18T12:57:33.767 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.1] 2024-09-18T12:57:33.767 INFO:teuthology.orchestra.run.smithi178.stdout: crimson seastar cpu cores = 2-3 2024-09-18T12:57:33.768 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.2] 2024-09-18T12:57:33.768 INFO:teuthology.orchestra.run.smithi178.stdout: crimson seastar cpu cores = 4-5 2024-09-18T12:57:33.769 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-18T12:57:33.769 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-18T12:57:33.875 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-18T12:57:33.875 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:33.875 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-18T12:57:33.890 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:33.890 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-18T12:57:33.945 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi178.front.sepia.ceph.com 2024-09-18T12:57:33.945 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:33.945 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T12:57:33.945 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T12:57:34.019 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:34.019 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:34.075 INFO:tasks.ceph:Setting up mon nodes... 2024-09-18T12:57:34.076 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-18T12:57:34.076 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T12:57:34.175 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T12:57:34.178 INFO:tasks.ceph:Setting up mds nodes... 2024-09-18T12:57:34.178 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-18T12:57:34.178 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-18T12:57:34.228 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-18T12:57:34.241 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-18T12:57:34.241 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-18T12:57:34.241 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-18T12:57:34.265 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-18T12:57:34.266 INFO:tasks.ceph:role: osd.0 2024-09-18T12:57:34.266 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-18T12:57:34.266 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T12:57:34.331 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T12:57:34.331 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T12:57:34.331 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T12:57:34.331 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T12:57:34.331 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T12:57:34.331 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-09-18T12:57:34.331 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T12:57:34.331 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T12:57:34.331 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T12:57:34.331 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T12:57:34.363 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-09-18T12:57:34.365 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-09-18T12:57:34.366 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-18T12:57:34.436 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-18T12:57:34.507 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-18T12:57:34.571 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-18T12:57:34.571 INFO:tasks.ceph:role: osd.1 2024-09-18T12:57:34.571 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-18T12:57:34.571 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-18T12:57:34.636 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T12:57:34.636 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T12:57:34.636 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T12:57:34.636 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T12:57:34.636 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T12:57:34.636 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-09-18T12:57:34.636 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T12:57:34.636 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T12:57:34.636 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T12:57:34.636 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T12:57:34.668 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-09-18T12:57:34.670 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-09-18T12:57:34.670 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-18T12:57:34.740 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-18T12:57:34.810 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-18T12:57:34.875 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-18T12:57:34.875 INFO:tasks.ceph:role: osd.2 2024-09-18T12:57:34.875 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-18T12:57:34.875 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-18T12:57:34.939 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T12:57:34.939 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T12:57:34.939 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T12:57:34.940 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T12:57:34.940 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T12:57:34.940 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-09-18T12:57:34.940 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T12:57:34.940 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T12:57:34.940 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T12:57:34.940 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T12:57:34.972 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-09-18T12:57:34.974 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-09-18T12:57:34.974 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-18T12:57:35.043 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-18T12:57:35.112 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:35.429 INFO:teuthology.orchestra.run.smithi178.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-18T12:57:35.430 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2024-09-18 12:57:35,430 seastar - Reactor backend: linux-aio 2024-09-18T12:57:35.443 INFO:teuthology.orchestra.run.smithi178.stderr:==27667==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-18T12:57:35.562 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2024-09-18 12:57:35,562 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-18T12:57:35.563 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2024-09-18 12:57:35,562 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-1 2024-09-18T12:57:35.563 INFO:teuthology.orchestra.run.smithi178.stderr:DEBUG 2024-09-18 12:57:35,563 [shard 0:main] seastar - reactor::drain 2024-09-18T12:57:36.072 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2024-09-18T12:57:36.072 INFO:teuthology.orchestra.run.smithi178.stderr:Suppressions used: 2024-09-18T12:57:36.072 INFO:teuthology.orchestra.run.smithi178.stderr: count bytes template 2024-09-18T12:57:36.072 INFO:teuthology.orchestra.run.smithi178.stderr: 1 8 MallocExtension::Register 2024-09-18T12:57:36.072 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2024-09-18T12:57:36.072 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-09-18T12:57:36.135 INFO:teuthology.orchestra.run.smithi178.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-18T12:57:36.138 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2024-09-18 12:57:36,138 seastar - Reactor backend: linux-aio 2024-09-18T12:57:36.146 INFO:teuthology.orchestra.run.smithi178.stderr:==27664==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-18T12:57:40.806 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2024-09-18T12:57:40.806 INFO:teuthology.orchestra.run.smithi178.stderr:Suppressions used: 2024-09-18T12:57:40.806 INFO:teuthology.orchestra.run.smithi178.stderr: count bytes template 2024-09-18T12:57:40.806 INFO:teuthology.orchestra.run.smithi178.stderr: 1 8 MallocExtension::Register 2024-09-18T12:57:40.806 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2024-09-18T12:57:40.807 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-09-18T12:57:40.830 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T12:57:40.854 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:41.131 INFO:teuthology.orchestra.run.smithi178.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-18T12:57:41.132 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2024-09-18 12:57:41,132 seastar - Reactor backend: linux-aio 2024-09-18T12:57:41.137 INFO:teuthology.orchestra.run.smithi178.stderr:==27851==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-18T12:57:41.244 INFO:teuthology.orchestra.run.smithi178.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc9da0f 0xbb76399 0xbb77904 0xbb77b1a 0xbb77c70 0xbb78139 0x3e6ef 0x133d0c 0xdd332 0x4ab1c 0x5fd8526 0x5fd8708 0x5fd891f 0x5fd8bf5 0x60272f3 0x60274f9 0x5fa7646 0x5fa7b7a 0x5def937 0x5e07b79 0x71461d2 0x71579a5 0x7158e42 0x7158ec7 0x7158fc9 0x71590c1 0x71592ce 0x71594b4 0x7159803 0x7159ba7 0x7159dd7 0x715a041 0x715a30e 0x715a52c 0x715a5e4 0x715a6aa 0x715a78b 0x5c52778 0x5c52882 0x5c5293e 0x5c529fa 0x5c52ab6 0x5c52c03 0x5c52d8e 0x5c5314f 0x5c6cf52 0xbb8a947 0xbba27c5 0xbc5006f 0xbc516bd 0xb91ff8d 0xb9207c5 0x3968cb2 0x396a48c 0x380ade2 0x2958f 0x2963f 0x35f29b4 2024-09-18T12:57:41.245 INFO:teuthology.orchestra.run.smithi178.stderr:kernel callstack: 2024-09-18T12:57:41.258 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2024-09-18 12:57:41,258 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-18T12:57:41.259 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2024-09-18 12:57:41,258 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 2-3 2024-09-18T12:57:41.259 INFO:teuthology.orchestra.run.smithi178.stderr:DEBUG 2024-09-18 12:57:41,259 [shard 0:main] seastar - reactor::drain 2024-09-18T12:57:41.757 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2024-09-18T12:57:41.757 INFO:teuthology.orchestra.run.smithi178.stderr:Suppressions used: 2024-09-18T12:57:41.757 INFO:teuthology.orchestra.run.smithi178.stderr: count bytes template 2024-09-18T12:57:41.757 INFO:teuthology.orchestra.run.smithi178.stderr: 1 8 MallocExtension::Register 2024-09-18T12:57:41.757 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2024-09-18T12:57:41.757 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-09-18T12:57:41.809 INFO:teuthology.orchestra.run.smithi178.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-18T12:57:41.813 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2024-09-18 12:57:41,812 seastar - Reactor backend: linux-aio 2024-09-18T12:57:41.833 INFO:teuthology.orchestra.run.smithi178.stderr:==27849==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-18T12:57:46.751 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2024-09-18T12:57:46.751 INFO:teuthology.orchestra.run.smithi178.stderr:Suppressions used: 2024-09-18T12:57:46.751 INFO:teuthology.orchestra.run.smithi178.stderr: count bytes template 2024-09-18T12:57:46.751 INFO:teuthology.orchestra.run.smithi178.stderr: 1 8 MallocExtension::Register 2024-09-18T12:57:46.751 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2024-09-18T12:57:46.752 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-09-18T12:57:46.774 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:57:46.799 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:47.090 INFO:teuthology.orchestra.run.smithi178.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-18T12:57:47.091 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2024-09-18 12:57:47,091 seastar - Reactor backend: linux-aio 2024-09-18T12:57:47.096 INFO:teuthology.orchestra.run.smithi178.stderr:==28035==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-18T12:57:47.215 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2024-09-18 12:57:47,215 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-18T12:57:47.215 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2024-09-18 12:57:47,215 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 4-5 2024-09-18T12:57:47.216 INFO:teuthology.orchestra.run.smithi178.stderr:DEBUG 2024-09-18 12:57:47,216 [shard 0:main] seastar - reactor::drain 2024-09-18T12:57:47.717 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2024-09-18T12:57:47.718 INFO:teuthology.orchestra.run.smithi178.stderr:Suppressions used: 2024-09-18T12:57:47.718 INFO:teuthology.orchestra.run.smithi178.stderr: count bytes template 2024-09-18T12:57:47.718 INFO:teuthology.orchestra.run.smithi178.stderr: 1 8 MallocExtension::Register 2024-09-18T12:57:47.718 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2024-09-18T12:57:47.718 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-09-18T12:57:47.774 INFO:teuthology.orchestra.run.smithi178.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-18T12:57:47.778 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2024-09-18 12:57:47,778 seastar - Reactor backend: linux-aio 2024-09-18T12:57:47.791 INFO:teuthology.orchestra.run.smithi178.stderr:==28033==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-18T12:57:52.466 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2024-09-18T12:57:52.466 INFO:teuthology.orchestra.run.smithi178.stderr:Suppressions used: 2024-09-18T12:57:52.466 INFO:teuthology.orchestra.run.smithi178.stderr: count bytes template 2024-09-18T12:57:52.466 INFO:teuthology.orchestra.run.smithi178.stderr: 1 8 MallocExtension::Register 2024-09-18T12:57:52.466 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2024-09-18T12:57:52.466 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-09-18T12:57:52.488 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T12:57:52.512 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-18T12:57:52.513 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:52.513 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-18T12:57:52.577 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:52.577 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-18T12:57:52.641 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:52.642 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-18T12:57:52.706 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:52.706 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-18T12:57:52.771 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:52.771 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-18T12:57:52.827 INFO:tasks.ceph:Adding keys to all mons... 2024-09-18T12:57:52.827 DEBUG:teuthology.orchestra.run.smithi178:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-18T12:57:52.890 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.x] 2024-09-18T12:57:52.890 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQA+zupmW5dwChAAB83wALPafXIcUlhX3qiJtA== 2024-09-18T12:57:52.890 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.0] 2024-09-18T12:57:52.890 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBAzupmjTZdERAAGCjFdMEw6bJ6V8zo3yq7Gg== 2024-09-18T12:57:52.890 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.1] 2024-09-18T12:57:52.890 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBFzupmZRIxOhAAJOITNwOMkkvG69Mdoq4Vsw== 2024-09-18T12:57:52.891 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.2] 2024-09-18T12:57:52.891 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBLzupmx/GgNxAAalsL643KBOiGgw6XpiLgZQ== 2024-09-18T12:57:52.891 INFO:teuthology.orchestra.run.smithi178.stdout:[client.0] 2024-09-18T12:57:52.891 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQA+zupmQaaWDRAAHDj8yhcsGTKPyRIjJdKBLg== 2024-09-18T12:57:52.892 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T12:57:52.994 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:57:53.056 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:57:53.117 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:57:53.178 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T12:57:53.242 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-18T12:57:53.243 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-18T12:57:53.267 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-18T12:57:53.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:53.386+0000 7fdabf8cfc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:53.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:53.386+0000 7fdabf8cfc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:53.401 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-18T12:57:53.425 DEBUG:teuthology.orchestra.run.smithi178:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:53.481 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-18T12:57:53.481 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-18T12:57:53.481 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-18T12:57:53.524 INFO:tasks.ceph.mon.a:Started 2024-09-18T12:57:53.524 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-18T12:57:53.524 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-18T12:57:53.524 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-18T12:57:53.526 INFO:tasks.ceph.mgr.x:Started 2024-09-18T12:57:53.526 DEBUG:tasks.ceph:set 0 configs 2024-09-18T12:57:53.526 INFO:tasks.ceph:Setting crush tunables to default 2024-09-18T12:57:53.527 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd crush tunables default 2024-09-18T12:57:53.611 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-18T12:57:53.609+0000 7f71461cf000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:53.611 INFO:tasks.ceph.mon.a.smithi178.stderr:2024-09-18T12:57:53.609+0000 7f305791fc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:53.612 INFO:tasks.ceph.mon.a.smithi178.stderr:2024-09-18T12:57:53.609+0000 7f305791fc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:53.612 INFO:tasks.ceph.mon.a.smithi178.stderr:2024-09-18T12:57:53.610+0000 7f305791fc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:53.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:53.632+0000 7fc83a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:53.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:53.643+0000 7fc83a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:53.716 INFO:teuthology.orchestra.run.smithi178.stderr:adjusted tunables profile to default 2024-09-18T12:57:53.728 INFO:tasks.ceph:check_enable_crimson: True 2024-09-18T12:57:53.729 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-18T12:57:53.729 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-18T12:57:53.817 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-18T12:57:53.815+0000 7f71461cf000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:53.817 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-18T12:57:53.816+0000 7f71461cf000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:53.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:53.830+0000 7f675d0a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:53.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:53.839+0000 7f675d0a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:53.922 INFO:tasks.ceph.mon.a.smithi178.stderr:2024-09-18T12:57:53.920+0000 7f304e5f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-18T12:57:53.922 INFO:tasks.ceph.mon.a.smithi178.stderr:Please be aware that this feature is experimental, untested, 2024-09-18T12:57:53.922 INFO:tasks.ceph.mon.a.smithi178.stderr:unsupported, and may result in data corruption, data loss, 2024-09-18T12:57:53.922 INFO:tasks.ceph.mon.a.smithi178.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-18T12:57:53.922 INFO:tasks.ceph.mon.a.smithi178.stderr:feature with important data. 2024-09-18T12:57:53.922 INFO:tasks.ceph.mon.a.smithi178.stderr: 2024-09-18T12:57:54.732 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-18T12:57:54.732 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:54.732 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-18T12:57:54.757 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:54.757 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-18T12:57:54.822 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:57:54.822 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-18T12:57:54.887 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 51c42150-67df-4e25-8bce-f32fe9d38bf6 0 2024-09-18T12:57:55.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:55.026+0000 7f7a42151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:55.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:55.036+0000 7f7a42151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:55.114 INFO:teuthology.orchestra.run.smithi178.stdout:0 2024-09-18T12:57:55.126 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 9df4c8a5-d349-420e-a0eb-ab72306f3279 1 2024-09-18T12:57:55.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:55.225+0000 7f4ce2b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:55.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:55.235+0000 7f4ce2b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:55.314 INFO:teuthology.orchestra.run.smithi178.stdout:1 2024-09-18T12:57:55.326 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 7acc6422-dacf-4fbf-8af5-0aa6c374be4f 2 2024-09-18T12:57:55.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:55.425+0000 7f779b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:55.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:55.435+0000 7f779b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:55.514 INFO:teuthology.orchestra.run.smithi178.stdout:2 2024-09-18T12:57:55.525 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-18T12:57:55.555 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-18T12:57:55.555 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-18T12:57:55.597 INFO:tasks.ceph.osd.0:Started 2024-09-18T12:57:55.598 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-18T12:57:55.627 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-18T12:57:55.627 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-18T12:57:55.670 INFO:tasks.ceph.osd.1:Started 2024-09-18T12:57:55.670 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-18T12:57:55.700 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-18T12:57:55.700 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-18T12:57:55.742 INFO:tasks.ceph.osd.2:Started 2024-09-18T12:57:55.742 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T12:57:55.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:55.898+0000 7ff31a551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:55.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:57:55.908+0000 7ff31a551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:56.033 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:57:56.033 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":6,"fsid":"ef2e64fd-507f-40d9-bf22-5b28c8ab36ed","created":"2024-09-18T12:57:53.632189+0000","modified":"2024-09-18T12:57:55.513443+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T12:57:55.513443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"51c42150-67df-4e25-8bce-f32fe9d38bf6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9df4c8a5-d349-420e-a0eb-ab72306f3279","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7acc6422-dacf-4fbf-8af5-0aa6c374be4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:57:56.048 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-18T12:57:56.048 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-18T12:57:56.350 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T12:57:56.454 INFO:teuthology.misc.health.smithi178.stderr:2024-09-18T12:57:56.448+0000 7fedc7efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:56.459 INFO:teuthology.misc.health.smithi178.stderr:2024-09-18T12:57:56.457+0000 7fedc7efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:56.527 INFO:teuthology.misc.health.smithi178.stdout: 2024-09-18T12:57:56.527 INFO:teuthology.misc.health.smithi178.stdout:{"epoch":6,"fsid":"ef2e64fd-507f-40d9-bf22-5b28c8ab36ed","created":"2024-09-18T12:57:53.632189+0000","modified":"2024-09-18T12:57:55.513443+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T12:57:55.513443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"51c42150-67df-4e25-8bce-f32fe9d38bf6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9df4c8a5-d349-420e-a0eb-ab72306f3279","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7acc6422-dacf-4fbf-8af5-0aa6c374be4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:57:56.539 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-18T12:57:59.244 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-18T12:57:59.243+0000 7f70e339e640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-18T12:58:02.842 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T12:58:02.946 INFO:teuthology.misc.health.smithi178.stderr:2024-09-18T12:58:02.941+0000 7f8767911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:02.950 INFO:teuthology.misc.health.smithi178.stderr:2024-09-18T12:58:02.948+0000 7f8767911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:03.136 INFO:teuthology.misc.health.smithi178.stdout: 2024-09-18T12:58:03.136 INFO:teuthology.misc.health.smithi178.stdout:{"epoch":8,"fsid":"ef2e64fd-507f-40d9-bf22-5b28c8ab36ed","created":"2024-09-18T12:57:53.632189+0000","modified":"2024-09-18T12:58:02.247814+0000","last_up_change":"2024-09-18T12:58:02.247814+0000","last_in_change":"2024-09-18T12:57:55.513443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"51c42150-67df-4e25-8bce-f32fe9d38bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":3869263817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3869263817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3869263817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":3869263817}]},"public_addr":"172.21.15.178:6803/3869263817","cluster_addr":"172.21.15.178:6802/3869263817","heartbeat_back_addr":"172.21.15.178:6812/3869263817","heartbeat_front_addr":"172.21.15.178:6811/3869263817","state":["exists","up"]},{"osd":1,"uuid":"9df4c8a5-d349-420e-a0eb-ab72306f3279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2713647840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":2713647840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2713647840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":2713647840}]},"public_addr":"172.21.15.178:6806/2713647840","cluster_addr":"172.21.15.178:6807/2713647840","heartbeat_back_addr":"172.21.15.178:6809/2713647840","heartbeat_front_addr":"172.21.15.178:6808/2713647840","state":["exists","up"]},{"osd":2,"uuid":"7acc6422-dacf-4fbf-8af5-0aa6c374be4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":4169439159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":4169439159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":4169439159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":4169439159}]},"public_addr":"172.21.15.178:6804/4169439159","cluster_addr":"172.21.15.178:6805/4169439159","heartbeat_back_addr":"172.21.15.178:6810/4169439159","heartbeat_front_addr":"172.21.15.178:6813/4169439159","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:58:03.147 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-18T12:58:03.147 INFO:tasks.ceph:Creating RBD pool 2024-09-18T12:58:03.148 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-18T12:58:03.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:03.245+0000 7f043b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:03.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:03.261+0000 7f043b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:04.258 INFO:teuthology.orchestra.run.smithi178.stderr:pool 'rbd' created 2024-09-18T12:58:04.283 DEBUG:teuthology.orchestra.run.smithi178:> rbd --cluster ceph pool init rbd 2024-09-18T12:58:04.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:04.382+0000 7f1f0744cac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:04.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:04.382+0000 7f1f0744cac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:04.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:04.388+0000 7f1f0744cac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:07.318 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-18T12:58:07.319 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-18T12:58:07.319 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-18T12:58:07.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:07.423+0000 7f748f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:07.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:07.431+0000 7f748f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:07.619 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:58:07.632 INFO:teuthology.orchestra.run.smithi178.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-18T12:58:07.632 INFO:tasks.ceph_manager:config epoch is 1 2024-09-18T12:58:07.632 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-18T12:58:07.632 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-18T12:58:07.632 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-18T12:58:07.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:07.734+0000 7fbba4311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:07.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:07.741+0000 7fbba4311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:07.978 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:58:07.990 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":112135199},{"type":"v1","addr":"172.21.15.178:6801","nonce":112135199}]},"active_addr":"172.21.15.178:6801/112135199","active_change":"2024-09-18T12:57:58.235808+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":82325903}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":1060556541}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":2591723680}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":847759023}]}]} 2024-09-18T12:58:07.992 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-18T12:58:07.992 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-18T12:58:07.992 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T12:58:08.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.095+0000 7f7be5246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:08.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.102+0000 7f7be5246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:08.290 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:58:08.290 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":13,"fsid":"ef2e64fd-507f-40d9-bf22-5b28c8ab36ed","created":"2024-09-18T12:57:53.632189+0000","modified":"2024-09-18T12:58:07.269309+0000","last_up_change":"2024-09-18T12:58:02.247814+0000","last_in_change":"2024-09-18T12:57:55.513443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:58:02.263663+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T12:58:03.462613+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"51c42150-67df-4e25-8bce-f32fe9d38bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":3869263817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3869263817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3869263817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":3869263817}]},"public_addr":"172.21.15.178:6803/3869263817","cluster_addr":"172.21.15.178:6802/3869263817","heartbeat_back_addr":"172.21.15.178:6812/3869263817","heartbeat_front_addr":"172.21.15.178:6811/3869263817","state":["exists","up"]},{"osd":1,"uuid":"9df4c8a5-d349-420e-a0eb-ab72306f3279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2713647840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":2713647840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2713647840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":2713647840}]},"public_addr":"172.21.15.178:6806/2713647840","cluster_addr":"172.21.15.178:6807/2713647840","heartbeat_back_addr":"172.21.15.178:6809/2713647840","heartbeat_front_addr":"172.21.15.178:6808/2713647840","state":["exists","up"]},{"osd":2,"uuid":"7acc6422-dacf-4fbf-8af5-0aa6c374be4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":4169439159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":4169439159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":4169439159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":4169439159}]},"public_addr":"172.21.15.178:6804/4169439159","cluster_addr":"172.21.15.178:6805/4169439159","heartbeat_back_addr":"172.21.15.178:6810/4169439159","heartbeat_front_addr":"172.21.15.178:6813/4169439159","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:58:08.304 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-18T12:58:08.304 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T12:58:08.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.406+0000 7f50b5f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:08.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.413+0000 7f50b5f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:08.599 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:58:08.599 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":13,"fsid":"ef2e64fd-507f-40d9-bf22-5b28c8ab36ed","created":"2024-09-18T12:57:53.632189+0000","modified":"2024-09-18T12:58:07.269309+0000","last_up_change":"2024-09-18T12:58:02.247814+0000","last_in_change":"2024-09-18T12:57:55.513443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:58:02.263663+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T12:58:03.462613+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"51c42150-67df-4e25-8bce-f32fe9d38bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":3869263817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3869263817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3869263817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":3869263817}]},"public_addr":"172.21.15.178:6803/3869263817","cluster_addr":"172.21.15.178:6802/3869263817","heartbeat_back_addr":"172.21.15.178:6812/3869263817","heartbeat_front_addr":"172.21.15.178:6811/3869263817","state":["exists","up"]},{"osd":1,"uuid":"9df4c8a5-d349-420e-a0eb-ab72306f3279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2713647840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":2713647840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2713647840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":2713647840}]},"public_addr":"172.21.15.178:6806/2713647840","cluster_addr":"172.21.15.178:6807/2713647840","heartbeat_back_addr":"172.21.15.178:6809/2713647840","heartbeat_front_addr":"172.21.15.178:6808/2713647840","state":["exists","up"]},{"osd":2,"uuid":"7acc6422-dacf-4fbf-8af5-0aa6c374be4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":4169439159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":4169439159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":4169439159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":4169439159}]},"public_addr":"172.21.15.178:6804/4169439159","cluster_addr":"172.21.15.178:6805/4169439159","heartbeat_back_addr":"172.21.15.178:6810/4169439159","heartbeat_front_addr":"172.21.15.178:6813/4169439159","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:58:08.612 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-18T12:58:08.613 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-18T12:58:08.613 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-18T12:58:08.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.721+0000 7fc69dd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:08.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.721+0000 7f96d3751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:08.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.722+0000 7f8dbad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:08.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.731+0000 7f96d3751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:08.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.731+0000 7f8dbad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:08.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.731+0000 7fc69dd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:08.766 INFO:teuthology.orchestra.run.smithi178.stdout:34359738374 2024-09-18T12:58:08.767 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T12:58:08.768 INFO:teuthology.orchestra.run.smithi178.stdout:34359738374 2024-09-18T12:58:08.769 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T12:58:08.769 INFO:teuthology.orchestra.run.smithi178.stdout:34359738374 2024-09-18T12:58:08.770 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T12:58:08.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.918+0000 7f68320d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:08.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.918+0000 7f6b1c0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:08.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.918+0000 7f497a711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:08.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.927+0000 7f497a711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:08.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.928+0000 7f68320d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:08.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:08.928+0000 7f6b1c0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:09.131 INFO:teuthology.orchestra.run.smithi178.stdout:34359738374 2024-09-18T12:58:09.141 INFO:teuthology.orchestra.run.smithi178.stdout:34359738374 2024-09-18T12:58:09.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2024-09-18T12:58:09.145 DEBUG:teuthology.parallel:result is None 2024-09-18T12:58:09.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.0 2024-09-18T12:58:09.158 INFO:teuthology.orchestra.run.smithi178.stdout:34359738374 2024-09-18T12:58:09.158 DEBUG:teuthology.parallel:result is None 2024-09-18T12:58:09.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.2 2024-09-18T12:58:09.171 DEBUG:teuthology.parallel:result is None 2024-09-18T12:58:09.171 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T12:58:09.171 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T12:58:09.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:09.315+0000 7fec5ca5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:09.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:09.323+0000 7fec5ca5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:09.509 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:58:09.509 INFO:teuthology.orchestra.run.smithi178.stderr:dumped all 2024-09-18T12:58:09.522 INFO:teuthology.orchestra.run.smithi178.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-18T12:58:08.755179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":80980,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283034540,"statfs":{"total":289910292480,"available":289827368960,"internally_reserved":0,"allocated":462848,"data_stored":1262998,"data_compressed":59988,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.287272+0000","last_change":"2024-09-18T12:58:07.294450+0000","last_active":"2024-09-18T12:58:07.287272+0000","last_peered":"2024-09-18T12:58:07.287272+0000","last_clean":"2024-09-18T12:58:07.287272+0000","last_became_active":"2024-09-18T12:58:05.359472+0000","last_became_peered":"2024-09-18T12:58:05.359472+0000","last_unstale":"2024-09-18T12:58:07.287272+0000","last_undegraded":"2024-09-18T12:58:07.287272+0000","last_fullsized":"2024-09-18T12:58:07.287272+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.296221+0000","last_change":"2024-09-18T12:58:07.301180+0000","last_active":"2024-09-18T12:58:07.296221+0000","last_peered":"2024-09-18T12:58:07.296221+0000","last_clean":"2024-09-18T12:58:07.296221+0000","last_became_active":"2024-09-18T12:58:05.381352+0000","last_became_peered":"2024-09-18T12:58:05.381352+0000","last_unstale":"2024-09-18T12:58:07.296221+0000","last_undegraded":"2024-09-18T12:58:07.296221+0000","last_fullsized":"2024-09-18T12:58:07.296221+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.285731+0000","last_change":"2024-09-18T12:58:07.293981+0000","last_active":"2024-09-18T12:58:07.285731+0000","last_peered":"2024-09-18T12:58:07.285731+0000","last_clean":"2024-09-18T12:58:07.285731+0000","last_became_active":"2024-09-18T12:58:05.334716+0000","last_became_peered":"2024-09-18T12:58:05.334716+0000","last_unstale":"2024-09-18T12:58:07.285731+0000","last_undegraded":"2024-09-18T12:58:07.285731+0000","last_fullsized":"2024-09-18T12:58:07.285731+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.294392+0000","last_change":"2024-09-18T12:58:07.299969+0000","last_active":"2024-09-18T12:58:07.294392+0000","last_peered":"2024-09-18T12:58:07.294392+0000","last_clean":"2024-09-18T12:58:07.294392+0000","last_became_active":"2024-09-18T12:58:05.367264+0000","last_became_peered":"2024-09-18T12:58:05.367264+0000","last_unstale":"2024-09-18T12:58:07.294392+0000","last_undegraded":"2024-09-18T12:58:07.294392+0000","last_fullsized":"2024-09-18T12:58:07.294392+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"13'2","reported_seq":17,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.296152+0000","last_change":"2024-09-18T12:58:07.296152+0000","last_active":"2024-09-18T12:58:07.296152+0000","last_peered":"2024-09-18T12:58:07.296152+0000","last_clean":"2024-09-18T12:58:07.296152+0000","last_became_active":"2024-09-18T12:58:05.351346+0000","last_became_peered":"2024-09-18T12:58:05.351346+0000","last_unstale":"2024-09-18T12:58:07.296152+0000","last_undegraded":"2024-09-18T12:58:07.296152+0000","last_fullsized":"2024-09-18T12:58:07.296152+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.294355+0000","last_change":"2024-09-18T12:58:07.296880+0000","last_active":"2024-09-18T12:58:07.294355+0000","last_peered":"2024-09-18T12:58:07.294355+0000","last_clean":"2024-09-18T12:58:07.294355+0000","last_became_active":"2024-09-18T12:58:05.380953+0000","last_became_peered":"2024-09-18T12:58:05.380953+0000","last_unstale":"2024-09-18T12:58:07.294355+0000","last_undegraded":"2024-09-18T12:58:07.294355+0000","last_fullsized":"2024-09-18T12:58:07.294355+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.289357+0000","last_change":"2024-09-18T12:58:07.296003+0000","last_active":"2024-09-18T12:58:07.289357+0000","last_peered":"2024-09-18T12:58:07.289357+0000","last_clean":"2024-09-18T12:58:07.289357+0000","last_became_active":"2024-09-18T12:58:05.356265+0000","last_became_peered":"2024-09-18T12:58:05.356265+0000","last_unstale":"2024-09-18T12:58:07.289357+0000","last_undegraded":"2024-09-18T12:58:07.289357+0000","last_fullsized":"2024-09-18T12:58:07.289357+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"11'1","reported_seq":16,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.295347+0000","last_change":"2024-09-18T12:58:07.300851+0000","last_active":"2024-09-18T12:58:07.295347+0000","last_peered":"2024-09-18T12:58:07.295347+0000","last_clean":"2024-09-18T12:58:07.295347+0000","last_became_active":"2024-09-18T12:58:05.338947+0000","last_became_peered":"2024-09-18T12:58:05.338947+0000","last_unstale":"2024-09-18T12:58:07.295347+0000","last_undegraded":"2024-09-18T12:58:07.295347+0000","last_fullsized":"2024-09-18T12:58:07.295347+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":84,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.289743+0000","last_change":"2024-09-18T12:58:04.328557+0000","last_active":"2024-09-18T12:58:07.289743+0000","last_peered":"2024-09-18T12:58:07.289743+0000","last_clean":"2024-09-18T12:58:07.289743+0000","last_became_active":"2024-09-18T12:58:04.317289+0000","last_became_peered":"2024-09-18T12:58:04.317289+0000","last_unstale":"2024-09-18T12:58:07.289743+0000","last_undegraded":"2024-09-18T12:58:07.289743+0000","last_fullsized":"2024-09-18T12:58:07.289743+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:03.253584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:03.253584+0000","last_clean_scrub_stamp":"2024-09-18T12:58:03.253584+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26940,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344900,"statfs":{"total":96636764160,"available":96609177600,"internally_reserved":0,"allocated":110592,"data_stored":27408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":176128,"data_stored":617795,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":176128,"data_stored":617795,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:58:09.523 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T12:58:09.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:09.626+0000 7fdfdb0ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:09.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:09.633+0000 7fdfdb0ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:09.818 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:58:09.819 INFO:teuthology.orchestra.run.smithi178.stderr:dumped all 2024-09-18T12:58:09.831 INFO:teuthology.orchestra.run.smithi178.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-18T12:58:08.755179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":80980,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283034540,"statfs":{"total":289910292480,"available":289827368960,"internally_reserved":0,"allocated":462848,"data_stored":1262998,"data_compressed":59988,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.287272+0000","last_change":"2024-09-18T12:58:07.294450+0000","last_active":"2024-09-18T12:58:07.287272+0000","last_peered":"2024-09-18T12:58:07.287272+0000","last_clean":"2024-09-18T12:58:07.287272+0000","last_became_active":"2024-09-18T12:58:05.359472+0000","last_became_peered":"2024-09-18T12:58:05.359472+0000","last_unstale":"2024-09-18T12:58:07.287272+0000","last_undegraded":"2024-09-18T12:58:07.287272+0000","last_fullsized":"2024-09-18T12:58:07.287272+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.296221+0000","last_change":"2024-09-18T12:58:07.301180+0000","last_active":"2024-09-18T12:58:07.296221+0000","last_peered":"2024-09-18T12:58:07.296221+0000","last_clean":"2024-09-18T12:58:07.296221+0000","last_became_active":"2024-09-18T12:58:05.381352+0000","last_became_peered":"2024-09-18T12:58:05.381352+0000","last_unstale":"2024-09-18T12:58:07.296221+0000","last_undegraded":"2024-09-18T12:58:07.296221+0000","last_fullsized":"2024-09-18T12:58:07.296221+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.285731+0000","last_change":"2024-09-18T12:58:07.293981+0000","last_active":"2024-09-18T12:58:07.285731+0000","last_peered":"2024-09-18T12:58:07.285731+0000","last_clean":"2024-09-18T12:58:07.285731+0000","last_became_active":"2024-09-18T12:58:05.334716+0000","last_became_peered":"2024-09-18T12:58:05.334716+0000","last_unstale":"2024-09-18T12:58:07.285731+0000","last_undegraded":"2024-09-18T12:58:07.285731+0000","last_fullsized":"2024-09-18T12:58:07.285731+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.294392+0000","last_change":"2024-09-18T12:58:07.299969+0000","last_active":"2024-09-18T12:58:07.294392+0000","last_peered":"2024-09-18T12:58:07.294392+0000","last_clean":"2024-09-18T12:58:07.294392+0000","last_became_active":"2024-09-18T12:58:05.367264+0000","last_became_peered":"2024-09-18T12:58:05.367264+0000","last_unstale":"2024-09-18T12:58:07.294392+0000","last_undegraded":"2024-09-18T12:58:07.294392+0000","last_fullsized":"2024-09-18T12:58:07.294392+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"13'2","reported_seq":17,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.296152+0000","last_change":"2024-09-18T12:58:07.296152+0000","last_active":"2024-09-18T12:58:07.296152+0000","last_peered":"2024-09-18T12:58:07.296152+0000","last_clean":"2024-09-18T12:58:07.296152+0000","last_became_active":"2024-09-18T12:58:05.351346+0000","last_became_peered":"2024-09-18T12:58:05.351346+0000","last_unstale":"2024-09-18T12:58:07.296152+0000","last_undegraded":"2024-09-18T12:58:07.296152+0000","last_fullsized":"2024-09-18T12:58:07.296152+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.294355+0000","last_change":"2024-09-18T12:58:07.296880+0000","last_active":"2024-09-18T12:58:07.294355+0000","last_peered":"2024-09-18T12:58:07.294355+0000","last_clean":"2024-09-18T12:58:07.294355+0000","last_became_active":"2024-09-18T12:58:05.380953+0000","last_became_peered":"2024-09-18T12:58:05.380953+0000","last_unstale":"2024-09-18T12:58:07.294355+0000","last_undegraded":"2024-09-18T12:58:07.294355+0000","last_fullsized":"2024-09-18T12:58:07.294355+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.289357+0000","last_change":"2024-09-18T12:58:07.296003+0000","last_active":"2024-09-18T12:58:07.289357+0000","last_peered":"2024-09-18T12:58:07.289357+0000","last_clean":"2024-09-18T12:58:07.289357+0000","last_became_active":"2024-09-18T12:58:05.356265+0000","last_became_peered":"2024-09-18T12:58:05.356265+0000","last_unstale":"2024-09-18T12:58:07.289357+0000","last_undegraded":"2024-09-18T12:58:07.289357+0000","last_fullsized":"2024-09-18T12:58:07.289357+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"11'1","reported_seq":16,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.295347+0000","last_change":"2024-09-18T12:58:07.300851+0000","last_active":"2024-09-18T12:58:07.295347+0000","last_peered":"2024-09-18T12:58:07.295347+0000","last_clean":"2024-09-18T12:58:07.295347+0000","last_became_active":"2024-09-18T12:58:05.338947+0000","last_became_peered":"2024-09-18T12:58:05.338947+0000","last_unstale":"2024-09-18T12:58:07.295347+0000","last_undegraded":"2024-09-18T12:58:07.295347+0000","last_fullsized":"2024-09-18T12:58:07.295347+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":84,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-18T12:58:07.289743+0000","last_change":"2024-09-18T12:58:04.328557+0000","last_active":"2024-09-18T12:58:07.289743+0000","last_peered":"2024-09-18T12:58:07.289743+0000","last_clean":"2024-09-18T12:58:07.289743+0000","last_became_active":"2024-09-18T12:58:04.317289+0000","last_became_peered":"2024-09-18T12:58:04.317289+0000","last_unstale":"2024-09-18T12:58:07.289743+0000","last_undegraded":"2024-09-18T12:58:07.289743+0000","last_fullsized":"2024-09-18T12:58:07.289743+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:03.253584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:03.253584+0000","last_clean_scrub_stamp":"2024-09-18T12:58:03.253584+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26940,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344900,"statfs":{"total":96636764160,"available":96609177600,"internally_reserved":0,"allocated":110592,"data_stored":27408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":176128,"data_stored":617795,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":176128,"data_stored":617795,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:58:09.832 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T12:58:09.832 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-18T12:58:09.832 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-18T12:58:09.832 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-18T12:58:09.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:09.935+0000 7f9a6c351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:09.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T12:58:09.941+0000 7f9a6c351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:58:10.162 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T12:58:10.162 INFO:teuthology.orchestra.run.smithi178.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-18T12:58:10.176 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-18T12:58:10.176 INFO:teuthology.run_tasks:Running task workunit... 2024-09-18T12:58:10.190 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-18T12:58:10.190 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-18T12:58:10.191 DEBUG:teuthology.orchestra.run.smithi178:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-18T12:58:10.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:58:10.206 INFO:teuthology.orchestra.run.smithi178.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-18T12:58:10.206 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-18T12:58:10.262 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-18T12:58:10.262 DEBUG:teuthology.orchestra.run.smithi178:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-18T12:58:10.318 INFO:tasks.workunit:timeout=3h 2024-09-18T12:58:10.318 INFO:tasks.workunit:cleanup=True 2024-09-18T12:58:10.318 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-18T12:58:10.375 INFO:tasks.workunit.client.0.smithi178.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-18T12:59:02.586 INFO:tasks.workunit.client.0.smithi178.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-09-18T12:59:02.587 INFO:tasks.workunit.client.0.smithi178.stderr: 2024-09-18T12:59:02.587 INFO:tasks.workunit.client.0.smithi178.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-18T12:59:02.587 INFO:tasks.workunit.client.0.smithi178.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-18T12:59:02.587 INFO:tasks.workunit.client.0.smithi178.stderr:state without impacting any branches by switching back to a branch. 2024-09-18T12:59:02.587 INFO:tasks.workunit.client.0.smithi178.stderr: 2024-09-18T12:59:02.587 INFO:tasks.workunit.client.0.smithi178.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-18T12:59:02.587 INFO:tasks.workunit.client.0.smithi178.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-18T12:59:02.587 INFO:tasks.workunit.client.0.smithi178.stderr: 2024-09-18T12:59:02.588 INFO:tasks.workunit.client.0.smithi178.stderr: git switch -c 2024-09-18T12:59:02.588 INFO:tasks.workunit.client.0.smithi178.stderr: 2024-09-18T12:59:02.588 INFO:tasks.workunit.client.0.smithi178.stderr:Or undo this operation with: 2024-09-18T12:59:02.588 INFO:tasks.workunit.client.0.smithi178.stderr: 2024-09-18T12:59:02.588 INFO:tasks.workunit.client.0.smithi178.stderr: git switch - 2024-09-18T12:59:02.588 INFO:tasks.workunit.client.0.smithi178.stderr: 2024-09-18T12:59:02.588 INFO:tasks.workunit.client.0.smithi178.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-18T12:59:02.588 INFO:tasks.workunit.client.0.smithi178.stderr: 2024-09-18T12:59:02.588 INFO:tasks.workunit.client.0.smithi178.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-09-18T12:59:02.591 DEBUG:teuthology.orchestra.run.smithi178:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-18T12:59:02.716 INFO:tasks.workunit.client.0.smithi178.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-18T12:59:02.718 INFO:tasks.workunit.client.0.smithi178.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-18T12:59:02.718 INFO:tasks.workunit.client.0.smithi178.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-18T12:59:03.334 INFO:tasks.workunit.client.0.smithi178.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-18T12:59:03.400 INFO:tasks.workunit.client.0.smithi178.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-18T12:59:03.441 INFO:tasks.workunit.client.0.smithi178.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-18T12:59:03.445 INFO:tasks.workunit.client.0.smithi178.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-18T12:59:03.445 INFO:tasks.workunit.client.0.smithi178.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-18T12:59:03.481 INFO:tasks.workunit.client.0.smithi178.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-18T12:59:03.485 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-18T12:59:03.485 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-18T12:59:03.500 INFO:tasks.workunit:Running workunits matching rbd/crimson/test_crimson_librbd.sh on client.0... 2024-09-18T12:59:03.502 INFO:tasks.workunit:Running workunit rbd/crimson/test_crimson_librbd.sh... 2024-09-18T12:59:03.502 DEBUG:teuthology.orchestra.run.smithi178:workunit test rbd/crimson/test_crimson_librbd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh 2024-09-18T12:59:03.608 INFO:tasks.workunit.client.0.smithi178.stdout:seed 30317 2024-09-18T12:59:03.609 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = TestLibRBD.* 2024-09-18T12:59:03.609 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 171 tests from 1 test suite. 2024-09-18T12:59:03.609 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T12:59:03.609 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 171 tests from TestLibRBD 2024-09-18T12:59:03.658 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.CreateAndStat 2024-09-18T12:59:05.659 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:07.865 INFO:tasks.workunit.client.0.smithi178.stdout:image has size 2097152 and order 22 2024-09-18T12:59:07.865 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.CreateAndStat (4208 ms) 2024-09-18T12:59:07.866 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.CreateWithSameDataPool 2024-09-18T12:59:07.866 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:08.029 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.CreateWithSameDataPool (164 ms) 2024-09-18T12:59:08.029 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.CreateAndStatPP 2024-09-18T12:59:08.029 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:08.205 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.CreateAndStatPP (176 ms) 2024-09-18T12:59:08.205 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.GetId 2024-09-18T12:59:08.205 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:08.457 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.GetId (251 ms) 2024-09-18T12:59:08.457 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.GetIdPP 2024-09-18T12:59:08.457 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:08.710 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.GetIdPP (253 ms) 2024-09-18T12:59:08.710 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefix 2024-09-18T12:59:08.710 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:08.868 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.GetBlockNamePrefix (159 ms) 2024-09-18T12:59:08.869 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefixPP 2024-09-18T12:59:08.869 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:09.032 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.GetBlockNamePrefixPP (164 ms) 2024-09-18T12:59:09.033 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestGetCreateTimestamp 2024-09-18T12:59:09.033 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:09.197 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestGetCreateTimestamp (164 ms) 2024-09-18T12:59:09.197 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.GetCreateTimestampPP 2024-09-18T12:59:09.197 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:09.368 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.GetCreateTimestampPP (172 ms) 2024-09-18T12:59:09.368 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.OpenAio 2024-09-18T12:59:09.369 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:09.532 INFO:tasks.workunit.client.0.smithi178.stdout:image has size 2097152 and order 22 2024-09-18T12:59:09.532 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.OpenAio (164 ms) 2024-09-18T12:59:09.532 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.OpenAioFail 2024-09-18T12:59:09.543 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.OpenAioFail (11 ms) 2024-09-18T12:59:09.544 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.OpenAioPP 2024-09-18T12:59:09.544 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:09.800 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.OpenAioPP (257 ms) 2024-09-18T12:59:09.800 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.OpenAioFailPP 2024-09-18T12:59:09.811 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.OpenAioFailPP (11 ms) 2024-09-18T12:59:09.811 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ResizeAndStat 2024-09-18T12:59:09.811 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:10.253 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.ResizeAndStat (442 ms) 2024-09-18T12:59:10.254 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ResizeAndStatPP 2024-09-18T12:59:10.254 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:10.631 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.ResizeAndStatPP (378 ms) 2024-09-18T12:59:10.632 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResize 2024-09-18T12:59:10.632 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:11.067 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.UpdateWatchAndResize (436 ms) 2024-09-18T12:59:11.068 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResizePP 2024-09-18T12:59:11.068 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:11.490 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.UpdateWatchAndResizePP (422 ms) 2024-09-18T12:59:11.490 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCreateLsDelete 2024-09-18T12:59:12.990 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:14.822 INFO:tasks.workunit.client.0.smithi178.stdout:image: image18 2024-09-18T12:59:14.822 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image18 2024-09-18T12:59:14.822 INFO:tasks.workunit.client.0.smithi178.stdout:found image18 2024-09-18T12:59:14.822 INFO:tasks.workunit.client.0.smithi178.stdout:erased image18 2024-09-18T12:59:14.822 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:15.674 INFO:tasks.workunit.client.0.smithi178.stdout:image: image18 2024-09-18T12:59:15.675 INFO:tasks.workunit.client.0.smithi178.stdout:image: image19 2024-09-18T12:59:15.675 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image18 2024-09-18T12:59:15.675 INFO:tasks.workunit.client.0.smithi178.stdout:found image18 2024-09-18T12:59:15.675 INFO:tasks.workunit.client.0.smithi178.stdout:erased image18 2024-09-18T12:59:15.675 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image19 2024-09-18T12:59:15.675 INFO:tasks.workunit.client.0.smithi178.stdout:found image19 2024-09-18T12:59:15.675 INFO:tasks.workunit.client.0.smithi178.stdout:erased image19 2024-09-18T12:59:15.675 INFO:tasks.workunit.client.0.smithi178.stdout:image: image19 2024-09-18T12:59:15.675 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image19 2024-09-18T12:59:15.675 INFO:tasks.workunit.client.0.smithi178.stdout:found image19 2024-09-18T12:59:15.675 INFO:tasks.workunit.client.0.smithi178.stdout:erased image19 2024-09-18T12:59:15.675 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCreateLsDelete (4185 ms) 2024-09-18T12:59:15.675 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCreateLsDeletePP 2024-09-18T12:59:17.696 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:19.857 INFO:tasks.workunit.client.0.smithi178.stdout:num images is: 1 2024-09-18T12:59:19.857 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 1 2024-09-18T12:59:19.857 INFO:tasks.workunit.client.0.smithi178.stdout:image: image20 2024-09-18T12:59:19.857 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image20 2024-09-18T12:59:19.857 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:19.943 INFO:tasks.workunit.client.0.smithi178.stdout:num images is: 2 2024-09-18T12:59:19.943 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 2 2024-09-18T12:59:19.943 INFO:tasks.workunit.client.0.smithi178.stdout:image: image20 2024-09-18T12:59:19.943 INFO:tasks.workunit.client.0.smithi178.stdout:image: image21 2024-09-18T12:59:19.943 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image20 2024-09-18T12:59:19.943 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image21 2024-09-18T12:59:20.620 INFO:tasks.workunit.client.0.smithi178.stdout:num images is: 1 2024-09-18T12:59:20.620 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 1 2024-09-18T12:59:20.620 INFO:tasks.workunit.client.0.smithi178.stdout:image: image21 2024-09-18T12:59:20.621 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image21 2024-09-18T12:59:20.621 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCreateLsDeletePP (4946 ms) 2024-09-18T12:59:20.621 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCopy 2024-09-18T12:59:21.712 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:29.146 INFO:tasks.workunit.client.0.smithi178.stdout:image: image22 2024-09-18T12:59:29.146 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image22 2024-09-18T12:59:29.146 INFO:tasks.workunit.client.0.smithi178.stdout:found image22 2024-09-18T12:59:29.146 INFO:tasks.workunit.client.0.smithi178.stdout:erased image22 2024-09-18T12:59:29.146 INFO:tasks.workunit.client.0.smithi178.stdout:image: image22 2024-09-18T12:59:29.146 INFO:tasks.workunit.client.0.smithi178.stdout:image: image23 2024-09-18T12:59:29.147 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image22 2024-09-18T12:59:29.147 INFO:tasks.workunit.client.0.smithi178.stdout:found image22 2024-09-18T12:59:29.147 INFO:tasks.workunit.client.0.smithi178.stdout:erased image22 2024-09-18T12:59:29.147 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image23 2024-09-18T12:59:29.147 INFO:tasks.workunit.client.0.smithi178.stdout:found image23 2024-09-18T12:59:29.147 INFO:tasks.workunit.client.0.smithi178.stdout:erased image23 2024-09-18T12:59:29.147 INFO:tasks.workunit.client.0.smithi178.stdout:100.00% done 2024-09-18T12:59:29.147 INFO:tasks.workunit.client.0.smithi178.stdout:image: image22 2024-09-18T12:59:29.147 INFO:tasks.workunit.client.0.smithi178.stdout:image: image23 2024-09-18T12:59:29.147 INFO:tasks.workunit.client.0.smithi178.stdout:image: image24 2024-09-18T12:59:29.147 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image22 2024-09-18T12:59:29.147 INFO:tasks.workunit.client.0.smithi178.stdout:found image22 2024-09-18T12:59:29.147 INFO:tasks.workunit.client.0.smithi178.stdout:erased image22 2024-09-18T12:59:29.148 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image23 2024-09-18T12:59:29.148 INFO:tasks.workunit.client.0.smithi178.stdout:found image23 2024-09-18T12:59:29.148 INFO:tasks.workunit.client.0.smithi178.stdout:erased image23 2024-09-18T12:59:29.148 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image24 2024-09-18T12:59:29.148 INFO:tasks.workunit.client.0.smithi178.stdout:found image24 2024-09-18T12:59:29.148 INFO:tasks.workunit.client.0.smithi178.stdout:erased image24 2024-09-18T12:59:29.148 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCopy (8525 ms) 2024-09-18T12:59:29.148 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCopyPP 2024-09-18T12:59:30.736 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:36.960 INFO:tasks.workunit.client.0.smithi178.stdout:num images is: 1 2024-09-18T12:59:36.960 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 1 2024-09-18T12:59:36.960 INFO:tasks.workunit.client.0.smithi178.stdout:image: image25 2024-09-18T12:59:36.960 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image25 2024-09-18T12:59:37.186 INFO:tasks.workunit.client.0.smithi178.stdout:num images is: 2 2024-09-18T12:59:37.186 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 2 2024-09-18T12:59:37.186 INFO:tasks.workunit.client.0.smithi178.stdout:image: image25 2024-09-18T12:59:37.186 INFO:tasks.workunit.client.0.smithi178.stdout:image: image26 2024-09-18T12:59:37.186 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image25 2024-09-18T12:59:37.186 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image26 2024-09-18T12:59:37.830 INFO:tasks.workunit.client.0.smithi178.stdout:100.00% done 2024-09-18T12:59:37.830 INFO:tasks.workunit.client.0.smithi178.stdout:num images is: 3 2024-09-18T12:59:37.830 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 3 2024-09-18T12:59:37.831 INFO:tasks.workunit.client.0.smithi178.stdout:image: image25 2024-09-18T12:59:37.831 INFO:tasks.workunit.client.0.smithi178.stdout:image: image26 2024-09-18T12:59:37.831 INFO:tasks.workunit.client.0.smithi178.stdout:image: image27 2024-09-18T12:59:37.831 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image25 2024-09-18T12:59:37.831 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image26 2024-09-18T12:59:37.831 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image27 2024-09-18T12:59:38.503 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCopyPP (9357 ms) 2024-09-18T12:59:38.503 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestDeepCopy 2024-09-18T12:59:39.752 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T12:59:53.755 INFO:tasks.workunit.client.0.smithi178.stdout:image: image28 2024-09-18T12:59:53.755 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image28 2024-09-18T12:59:53.755 INFO:tasks.workunit.client.0.smithi178.stdout:found image28 2024-09-18T12:59:53.755 INFO:tasks.workunit.client.0.smithi178.stdout:erased image28 2024-09-18T12:59:53.755 INFO:tasks.workunit.client.0.smithi178.stdout:image: image28 2024-09-18T12:59:53.756 INFO:tasks.workunit.client.0.smithi178.stdout:image: image29 2024-09-18T12:59:53.756 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image28 2024-09-18T12:59:53.756 INFO:tasks.workunit.client.0.smithi178.stdout:found image28 2024-09-18T12:59:53.756 INFO:tasks.workunit.client.0.smithi178.stdout:erased image28 2024-09-18T12:59:53.756 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image29 2024-09-18T12:59:53.756 INFO:tasks.workunit.client.0.smithi178.stdout:found image29 2024-09-18T12:59:53.756 INFO:tasks.workunit.client.0.smithi178.stdout:erased image29 2024-09-18T12:59:53.756 INFO:tasks.workunit.client.0.smithi178.stdout:100.00% done 2024-09-18T12:59:53.756 INFO:tasks.workunit.client.0.smithi178.stdout:image: image28 2024-09-18T12:59:53.756 INFO:tasks.workunit.client.0.smithi178.stdout:image: image29 2024-09-18T12:59:53.756 INFO:tasks.workunit.client.0.smithi178.stdout:image: image30 2024-09-18T12:59:53.756 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image28 2024-09-18T12:59:53.756 INFO:tasks.workunit.client.0.smithi178.stdout:found image28 2024-09-18T12:59:53.757 INFO:tasks.workunit.client.0.smithi178.stdout:erased image28 2024-09-18T12:59:53.757 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image29 2024-09-18T12:59:53.757 INFO:tasks.workunit.client.0.smithi178.stdout:found image29 2024-09-18T12:59:53.757 INFO:tasks.workunit.client.0.smithi178.stdout:erased image29 2024-09-18T12:59:53.757 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image30 2024-09-18T12:59:53.757 INFO:tasks.workunit.client.0.smithi178.stdout:found image30 2024-09-18T12:59:53.757 INFO:tasks.workunit.client.0.smithi178.stdout:erased image30 2024-09-18T12:59:53.757 INFO:tasks.workunit.client.0.smithi178.stdout:image: image28 2024-09-18T12:59:53.757 INFO:tasks.workunit.client.0.smithi178.stdout:image: image29 2024-09-18T12:59:53.757 INFO:tasks.workunit.client.0.smithi178.stdout:image: image30 2024-09-18T12:59:53.757 INFO:tasks.workunit.client.0.smithi178.stdout:image: image31 2024-09-18T12:59:53.757 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image28 2024-09-18T12:59:53.758 INFO:tasks.workunit.client.0.smithi178.stdout:found image28 2024-09-18T12:59:53.758 INFO:tasks.workunit.client.0.smithi178.stdout:erased image28 2024-09-18T12:59:53.758 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image29 2024-09-18T12:59:53.758 INFO:tasks.workunit.client.0.smithi178.stdout:found image29 2024-09-18T12:59:53.758 INFO:tasks.workunit.client.0.smithi178.stdout:erased image29 2024-09-18T12:59:53.758 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image30 2024-09-18T12:59:53.758 INFO:tasks.workunit.client.0.smithi178.stdout:found image30 2024-09-18T12:59:53.758 INFO:tasks.workunit.client.0.smithi178.stdout:erased image30 2024-09-18T12:59:53.758 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image31 2024-09-18T12:59:53.758 INFO:tasks.workunit.client.0.smithi178.stdout:found image31 2024-09-18T12:59:53.758 INFO:tasks.workunit.client.0.smithi178.stdout:erased image31 2024-09-18T12:59:53.758 INFO:tasks.workunit.client.0.smithi178.stdout:image: image28 2024-09-18T12:59:53.759 INFO:tasks.workunit.client.0.smithi178.stdout:image: image29 2024-09-18T12:59:53.759 INFO:tasks.workunit.client.0.smithi178.stdout:image: image30 2024-09-18T12:59:53.759 INFO:tasks.workunit.client.0.smithi178.stdout:image: image31 2024-09-18T12:59:53.759 INFO:tasks.workunit.client.0.smithi178.stdout:image: image32 2024-09-18T12:59:53.759 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image28 2024-09-18T12:59:53.759 INFO:tasks.workunit.client.0.smithi178.stdout:found image28 2024-09-18T12:59:53.759 INFO:tasks.workunit.client.0.smithi178.stdout:erased image28 2024-09-18T12:59:53.759 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image29 2024-09-18T12:59:53.759 INFO:tasks.workunit.client.0.smithi178.stdout:found image29 2024-09-18T12:59:53.759 INFO:tasks.workunit.client.0.smithi178.stdout:erased image29 2024-09-18T12:59:53.759 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image30 2024-09-18T12:59:53.759 INFO:tasks.workunit.client.0.smithi178.stdout:found image30 2024-09-18T12:59:53.759 INFO:tasks.workunit.client.0.smithi178.stdout:erased image30 2024-09-18T12:59:53.760 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image31 2024-09-18T12:59:53.760 INFO:tasks.workunit.client.0.smithi178.stdout:found image31 2024-09-18T12:59:53.760 INFO:tasks.workunit.client.0.smithi178.stdout:erased image31 2024-09-18T12:59:53.760 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image32 2024-09-18T12:59:53.760 INFO:tasks.workunit.client.0.smithi178.stdout:found image32 2024-09-18T12:59:53.760 INFO:tasks.workunit.client.0.smithi178.stdout:erased image32 2024-09-18T12:59:53.760 INFO:tasks.workunit.client.0.smithi178.stdout:100.00% done 2024-09-18T12:59:53.760 INFO:tasks.workunit.client.0.smithi178.stdout:image: image28 2024-09-18T12:59:53.760 INFO:tasks.workunit.client.0.smithi178.stdout:image: image29 2024-09-18T12:59:53.760 INFO:tasks.workunit.client.0.smithi178.stdout:image: image30 2024-09-18T12:59:53.760 INFO:tasks.workunit.client.0.smithi178.stdout:image: image31 2024-09-18T12:59:53.760 INFO:tasks.workunit.client.0.smithi178.stdout:image: image32 2024-09-18T12:59:53.761 INFO:tasks.workunit.client.0.smithi178.stdout:image: image33 2024-09-18T12:59:53.761 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image28 2024-09-18T12:59:53.761 INFO:tasks.workunit.client.0.smithi178.stdout:found image28 2024-09-18T12:59:53.761 INFO:tasks.workunit.client.0.smithi178.stdout:erased image28 2024-09-18T12:59:53.761 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image29 2024-09-18T12:59:53.761 INFO:tasks.workunit.client.0.smithi178.stdout:found image29 2024-09-18T12:59:53.761 INFO:tasks.workunit.client.0.smithi178.stdout:erased image29 2024-09-18T12:59:53.761 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image30 2024-09-18T12:59:53.761 INFO:tasks.workunit.client.0.smithi178.stdout:found image30 2024-09-18T12:59:53.761 INFO:tasks.workunit.client.0.smithi178.stdout:erased image30 2024-09-18T12:59:53.761 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image31 2024-09-18T12:59:53.761 INFO:tasks.workunit.client.0.smithi178.stdout:found image31 2024-09-18T12:59:53.761 INFO:tasks.workunit.client.0.smithi178.stdout:erased image31 2024-09-18T12:59:53.761 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image32 2024-09-18T12:59:53.761 INFO:tasks.workunit.client.0.smithi178.stdout:found image32 2024-09-18T12:59:53.762 INFO:tasks.workunit.client.0.smithi178.stdout:erased image32 2024-09-18T12:59:53.762 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image33 2024-09-18T12:59:53.762 INFO:tasks.workunit.client.0.smithi178.stdout:found image33 2024-09-18T12:59:53.762 INFO:tasks.workunit.client.0.smithi178.stdout:erased image33 2024-09-18T12:59:53.762 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestDeepCopy (15253 ms) 2024-09-18T12:59:53.762 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestDeepCopyPP 2024-09-18T12:59:55.792 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:00:02.051 INFO:tasks.workunit.client.0.smithi178.stdout:num images is: 1 2024-09-18T13:00:02.052 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 1 2024-09-18T13:00:02.052 INFO:tasks.workunit.client.0.smithi178.stdout:image: image34 2024-09-18T13:00:02.052 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image34 2024-09-18T13:00:02.379 INFO:tasks.workunit.client.0.smithi178.stdout:num images is: 2 2024-09-18T13:00:02.380 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 2 2024-09-18T13:00:02.380 INFO:tasks.workunit.client.0.smithi178.stdout:image: image34 2024-09-18T13:00:02.380 INFO:tasks.workunit.client.0.smithi178.stdout:image: image35 2024-09-18T13:00:02.380 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image34 2024-09-18T13:00:02.380 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image35 2024-09-18T13:00:03.216 INFO:tasks.workunit.client.0.smithi178.stdout:100.00% done 2024-09-18T13:00:03.216 INFO:tasks.workunit.client.0.smithi178.stdout:num images is: 3 2024-09-18T13:00:03.216 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 3 2024-09-18T13:00:03.216 INFO:tasks.workunit.client.0.smithi178.stdout:image: image34 2024-09-18T13:00:03.216 INFO:tasks.workunit.client.0.smithi178.stdout:image: image35 2024-09-18T13:00:03.216 INFO:tasks.workunit.client.0.smithi178.stdout:image: image36 2024-09-18T13:00:03.216 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image34 2024-09-18T13:00:03.216 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image35 2024-09-18T13:00:03.217 INFO:tasks.workunit.client.0.smithi178.stdout:expected = image36 2024-09-18T13:00:03.791 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestDeepCopyPP (10036 ms) 2024-09-18T13:00:03.792 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnap 2024-09-18T13:00:03.792 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:00:08.056 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 1 2024-09-18T13:00:08.057 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 1 2024-09-18T13:00:08.057 INFO:tasks.workunit.client.0.smithi178.stdout:snap: snap1 2024-09-18T13:00:08.057 INFO:tasks.workunit.client.0.smithi178.stdout:found snap1 with size 2097152 2024-09-18T13:00:08.057 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 2 2024-09-18T13:00:08.057 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 2 2024-09-18T13:00:08.057 INFO:tasks.workunit.client.0.smithi178.stdout:snap: snap1 2024-09-18T13:00:08.057 INFO:tasks.workunit.client.0.smithi178.stdout:snap: snap2 2024-09-18T13:00:08.057 INFO:tasks.workunit.client.0.smithi178.stdout:found snap1 with size 2097152 2024-09-18T13:00:08.057 INFO:tasks.workunit.client.0.smithi178.stdout:found snap2 with size 4194304 2024-09-18T13:00:08.057 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 1 2024-09-18T13:00:08.058 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 1 2024-09-18T13:00:08.058 INFO:tasks.workunit.client.0.smithi178.stdout:snap: snap2 2024-09-18T13:00:08.058 INFO:tasks.workunit.client.0.smithi178.stdout:found snap2 with size 4194304 2024-09-18T13:00:08.058 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 0 2024-09-18T13:00:08.058 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 0 2024-09-18T13:00:08.058 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnap (4265 ms) 2024-09-18T13:00:08.058 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestGetSnapShotTimeStamp 2024-09-18T13:00:08.058 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:00:10.197 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestGetSnapShotTimeStamp (2141 ms) 2024-09-18T13:00:10.198 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnapPP 2024-09-18T13:00:10.198 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:00:11.090 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 1 2024-09-18T13:00:11.090 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 1 2024-09-18T13:00:11.090 INFO:tasks.workunit.client.0.smithi178.stdout:snap: snap1 2024-09-18T13:00:11.090 INFO:tasks.workunit.client.0.smithi178.stdout:found snap1 with size 2097152 2024-09-18T13:00:12.079 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 2 2024-09-18T13:00:12.079 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 2 2024-09-18T13:00:12.079 INFO:tasks.workunit.client.0.smithi178.stdout:snap: snap1 2024-09-18T13:00:12.080 INFO:tasks.workunit.client.0.smithi178.stdout:snap: snap2 2024-09-18T13:00:12.080 INFO:tasks.workunit.client.0.smithi178.stdout:found snap1 with size 2097152 2024-09-18T13:00:12.080 INFO:tasks.workunit.client.0.smithi178.stdout:found snap2 with size 4194304 2024-09-18T13:00:13.062 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 1 2024-09-18T13:00:13.062 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 1 2024-09-18T13:00:13.062 INFO:tasks.workunit.client.0.smithi178.stdout:snap: snap2 2024-09-18T13:00:13.062 INFO:tasks.workunit.client.0.smithi178.stdout:found snap2 with size 4194304 2024-09-18T13:00:14.074 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 0 2024-09-18T13:00:14.074 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 0 2024-09-18T13:00:14.129 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnapPP (3932 ms) 2024-09-18T13:00:14.129 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestGetNameIdSnapPP 2024-09-18T13:00:14.129 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:00:20.079 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 0 2024-09-18T13:00:20.079 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 0 2024-09-18T13:00:20.143 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestGetNameIdSnapPP (6014 ms) 2024-09-18T13:00:20.143 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCreateLsRenameSnapPP 2024-09-18T13:00:20.143 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:00:21.095 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 1 2024-09-18T13:00:21.095 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 1 2024-09-18T13:00:21.095 INFO:tasks.workunit.client.0.smithi178.stdout:snap: snap1 2024-09-18T13:00:21.095 INFO:tasks.workunit.client.0.smithi178.stdout:found snap1 with size 2097152 2024-09-18T13:00:22.151 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 2 2024-09-18T13:00:22.151 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 2 2024-09-18T13:00:22.151 INFO:tasks.workunit.client.0.smithi178.stdout:snap: snap1 2024-09-18T13:00:22.151 INFO:tasks.workunit.client.0.smithi178.stdout:snap: snap2 2024-09-18T13:00:22.151 INFO:tasks.workunit.client.0.smithi178.stdout:found snap1 with size 2097152 2024-09-18T13:00:22.151 INFO:tasks.workunit.client.0.smithi178.stdout:found snap2 with size 4194304 2024-09-18T13:00:22.220 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 2 2024-09-18T13:00:22.220 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 2 2024-09-18T13:00:22.221 INFO:tasks.workunit.client.0.smithi178.stdout:snap: snap1-rename 2024-09-18T13:00:22.221 INFO:tasks.workunit.client.0.smithi178.stdout:snap: snap2 2024-09-18T13:00:22.221 INFO:tasks.workunit.client.0.smithi178.stdout:found snap1-rename with size 2097152 2024-09-18T13:00:22.221 INFO:tasks.workunit.client.0.smithi178.stdout:found snap2 with size 4194304 2024-09-18T13:00:23.157 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 1 2024-09-18T13:00:23.158 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 1 2024-09-18T13:00:23.158 INFO:tasks.workunit.client.0.smithi178.stdout:snap: snap2-rename 2024-09-18T13:00:23.158 INFO:tasks.workunit.client.0.smithi178.stdout:found snap2-rename with size 4194304 2024-09-18T13:00:24.079 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 0 2024-09-18T13:00:24.079 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 0 2024-09-18T13:00:24.128 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCreateLsRenameSnapPP (3985 ms) 2024-09-18T13:00:24.128 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ConcurrentCreatesUnvalidatedPool 2024-09-18T13:00:25.890 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:00:25.890 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:00:25.890 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:00:25.891 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:00:31.320 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.ConcurrentCreatesUnvalidatedPool (7192 ms) 2024-09-18T13:00:31.320 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.RemoveFullTry 2024-09-18T13:00:36.562 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:01:10.054 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.RemoveFullTry (38733 ms) 2024-09-18T13:01:10.054 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.RemoveFullTryDataPool 2024-09-18T13:01:16.955 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:01:39.674 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:01:40.995 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:01:42.075 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:01:43.170 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:01:44.254 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:01:45.078 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.RemoveFullTryDataPool (35025 ms) 2024-09-18T13:01:45.078 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespace 2024-09-18T13:01:47.475 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:02:09.835 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.RemoveFullTryNamespace (24756 ms) 2024-09-18T13:02:09.835 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespaceDataPool 2024-09-18T13:02:14.429 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:02:39.677 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:02:41.065 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:02:42.157 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:02:43.269 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:02:44.358 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:02:45.207 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.RemoveFullTryNamespaceDataPool (35373 ms) 2024-09-18T13:02:45.207 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestIO 2024-09-18T13:02:45.207 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:03:14.770 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:03:14.771 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:03:14.771 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:03:14.771 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:03:14.771 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:03:14.771 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.771 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:03:14.771 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.771 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.771 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:03:14.772 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.772 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:03:14.772 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.772 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.772 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:03:14.772 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.772 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:03:14.772 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.772 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.772 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:03:14.772 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.772 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:03:14.773 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.773 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.773 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:03:14.773 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.773 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:03:14.773 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.773 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.773 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:03:14.773 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:03:14.774 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:03:14.774 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:03:14.774 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:03:14.774 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:03:14.774 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:03:14.774 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:03:14.774 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:03:14.774 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:03:14.774 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:03:14.774 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.774 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:03:14.774 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.774 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.775 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:03:14.775 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.775 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:03:14.775 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.775 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.775 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:03:14.775 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.775 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:03:14.775 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.775 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.775 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:03:14.775 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.775 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:03:14.775 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.775 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.776 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:03:14.776 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.776 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:03:14.776 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.776 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.776 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:03:14.776 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:03:14.776 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:03:14.776 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:03:14.776 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:03:14.776 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:03:14.777 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.777 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:03:14.777 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:03:14.777 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:03:14.777 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.777 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:03:14.777 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:03:14.777 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:03:14.777 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.777 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:03:14.777 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:03:14.777 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:03:14.778 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.778 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:03:14.778 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:03:14.778 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:03:14.778 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.778 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:03:14.778 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:03:14.778 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:03:14.778 INFO:tasks.workunit.client.0.smithi178.stdout:discard: 512~512 = 512 2024-09-18T13:03:14.778 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.778 INFO:tasks.workunit.client.0.smithi178.stdout:aio discard: 1536~512 = 0 2024-09-18T13:03:14.778 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:03:14.779 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:03:14.779 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:03:14.779 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:03:14.779 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:03:14.779 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 0 2024-09-18T13:03:14.779 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.779 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.779 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 0 2024-09-18T13:03:14.779 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.779 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.779 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 16384 2024-09-18T13:03:14.780 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.780 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.780 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 16384 2024-09-18T13:03:14.780 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.780 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.781 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:14.781 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:14.781 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 49152 2024-09-18T13:03:14.781 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.781 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.781 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 49152 2024-09-18T13:03:14.781 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.781 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.781 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 65536 2024-09-18T13:03:14.782 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.782 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.782 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 65536 2024-09-18T13:03:14.782 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.782 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.782 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:14.782 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:14.782 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 98304 2024-09-18T13:03:14.782 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.782 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.782 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 98304 2024-09-18T13:03:14.782 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.782 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.782 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 114688 2024-09-18T13:03:14.783 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.783 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.783 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 114688 2024-09-18T13:03:14.783 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.783 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.783 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:14.783 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:14.783 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 147456 2024-09-18T13:03:14.783 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.783 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.783 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 147456 2024-09-18T13:03:14.783 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.783 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.783 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 163840 2024-09-18T13:03:14.784 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.784 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.784 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 163840 2024-09-18T13:03:14.784 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.784 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.784 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:14.784 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:14.784 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 196608 2024-09-18T13:03:14.784 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.784 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.784 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 196608 2024-09-18T13:03:14.784 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.784 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.784 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 212992 2024-09-18T13:03:14.784 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.785 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.785 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 212992 2024-09-18T13:03:14.785 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.785 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.785 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:14.785 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:14.785 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.785 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:14.785 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.785 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.785 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:14.785 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.785 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.786 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.786 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:14.786 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.786 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.786 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:14.786 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.786 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.786 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.786 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:14.786 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.786 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.786 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:14.786 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.787 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.787 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.787 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:14.787 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.787 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.787 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:14.787 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.787 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.787 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.787 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:14.787 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:14.787 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.788 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:14.788 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:14.788 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.788 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:14.788 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.788 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.788 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:14.788 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.788 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.788 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:14.788 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:14.788 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:14.788 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:14.788 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:14.789 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:14.789 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:14.789 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.158 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.158 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:39.158 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:39.158 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:39.158 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:39.158 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:39.158 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.158 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.158 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:39.158 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:39.159 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:39.159 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:39.159 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:39.159 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.159 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.159 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:39.159 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.159 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.159 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:39.159 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.159 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.159 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:39.159 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:39.159 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:39.160 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:39.160 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:39.160 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.160 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.160 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:39.160 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:39.160 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:39.160 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:39.160 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:39.160 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.160 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.160 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:39.160 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:39.160 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:39.161 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:39.161 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:39.161 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.161 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.161 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:39.161 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:39.161 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:39.161 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:39.161 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:39.161 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.162 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.162 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:39.162 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.162 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.162 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:39.162 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.162 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.162 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:39.162 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:39.162 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:39.162 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:39.162 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:39.162 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.163 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.163 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:39.163 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:39.163 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:39.163 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:39.163 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:39.163 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.164 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.164 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:39.164 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:39.164 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:39.164 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:39.164 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:39.164 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.164 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.164 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:39.164 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:39.165 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:39.165 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:39.165 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:39.165 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.165 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.165 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:39.165 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.165 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.165 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:39.166 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.166 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.166 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:39.166 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:39.166 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:39.166 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:39.166 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:39.166 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.166 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.166 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:39.166 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:39.166 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:39.166 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:39.167 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:39.167 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.167 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.167 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:39.167 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:39.167 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:39.167 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:39.167 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:39.167 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.167 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.168 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:03:39.168 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:03:39.168 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:03:39.168 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:03:39.168 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:03:39.168 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.168 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.168 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:39.168 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:03:39.168 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:03:39.168 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:03:39.168 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:03:39.168 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:03:39.169 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:03:39.169 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:03:39.169 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestIO (53950 ms) 2024-09-18T13:03:39.169 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS1 2024-09-18T13:03:39.169 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:04:11.386 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:04:11.387 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:04:11.387 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:04:11.387 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:04:11.387 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:04:11.387 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.387 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:04:11.388 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.388 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.388 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:04:11.388 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.388 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:04:11.388 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.388 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.389 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:04:11.389 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.389 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:04:11.389 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.389 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.389 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:04:11.389 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.389 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:04:11.389 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.390 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.390 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:04:11.390 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.390 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:04:11.390 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.390 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.390 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:04:11.390 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:04:11.390 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:04:11.391 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:04:11.391 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:04:11.391 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:04:11.391 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:04:11.391 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:04:11.391 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:04:11.391 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:04:11.391 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:04:11.391 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.391 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:04:11.391 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.391 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.391 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:04:11.392 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.392 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:04:11.392 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.392 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.392 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:04:11.392 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.392 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:04:11.392 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.392 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.392 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:04:11.392 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.392 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:04:11.392 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.393 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.393 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:04:11.393 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.393 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:04:11.393 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.393 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.393 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:04:11.393 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:04:11.393 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:04:11.393 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:04:11.393 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:04:11.393 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:04:11.393 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.393 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:04:11.393 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:04:11.394 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:04:11.394 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.394 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:04:11.394 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:04:11.394 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:04:11.394 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.394 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:04:11.394 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:04:11.394 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:04:11.394 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.395 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:04:11.395 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:04:11.395 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:04:11.395 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.395 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:04:11.395 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:04:11.395 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:04:11.395 INFO:tasks.workunit.client.0.smithi178.stdout:discard: 512~512 = 512 2024-09-18T13:04:11.395 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.395 INFO:tasks.workunit.client.0.smithi178.stdout:aio discard: 1536~512 = 0 2024-09-18T13:04:11.395 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:04:11.395 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:04:11.395 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:04:11.396 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:04:11.396 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:04:11.396 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 0 2024-09-18T13:04:11.396 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.396 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.396 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 0 2024-09-18T13:04:11.396 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.396 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.396 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 16384 2024-09-18T13:04:11.396 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.396 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.396 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 16384 2024-09-18T13:04:11.396 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.397 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.397 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:11.397 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:11.397 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 49152 2024-09-18T13:04:11.397 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.397 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.397 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 49152 2024-09-18T13:04:11.397 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.397 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.397 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 65536 2024-09-18T13:04:11.397 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.397 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.397 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 65536 2024-09-18T13:04:11.398 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.398 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.398 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:11.398 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:11.398 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 98304 2024-09-18T13:04:11.398 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.398 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.398 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 98304 2024-09-18T13:04:11.398 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.398 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.398 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 114688 2024-09-18T13:04:11.398 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.398 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.398 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 114688 2024-09-18T13:04:11.399 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.399 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.399 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:11.399 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:11.399 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 147456 2024-09-18T13:04:11.399 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.399 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.399 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 147456 2024-09-18T13:04:11.399 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.399 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.399 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 163840 2024-09-18T13:04:11.399 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.400 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.400 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 163840 2024-09-18T13:04:11.400 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.400 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.400 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:11.400 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:11.400 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 196608 2024-09-18T13:04:11.400 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.400 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.400 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 196608 2024-09-18T13:04:11.400 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.400 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.401 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 212992 2024-09-18T13:04:11.401 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.401 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.401 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 212992 2024-09-18T13:04:11.401 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.401 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.402 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:11.402 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:11.402 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.402 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:11.402 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.402 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.402 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:11.402 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.402 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.402 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.402 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:11.402 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.402 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.402 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:11.402 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.403 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.403 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.403 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:11.403 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.403 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.403 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:11.403 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.403 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.403 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.404 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:11.404 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.404 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.404 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:11.404 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.404 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.404 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.404 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:11.404 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:11.404 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.404 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:11.405 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:11.405 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.405 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:11.405 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.405 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.405 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:11.405 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.405 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.405 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:11.405 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:11.405 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:11.406 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:11.406 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:11.406 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:11.406 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:11.406 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.657 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.658 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:40.658 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:40.658 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:40.658 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:40.658 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:40.658 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.658 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.658 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:40.658 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:40.658 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:40.658 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:40.658 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:40.658 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.659 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.659 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:40.659 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.659 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.659 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:40.659 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.659 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.659 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:40.659 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:40.659 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:40.659 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:40.659 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:40.659 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.660 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.660 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:40.660 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:40.660 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:40.660 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:40.660 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:40.660 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.660 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.660 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:40.660 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:40.660 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:40.660 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:40.660 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:40.660 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.661 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.661 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:40.661 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:40.661 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:40.661 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:40.661 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:40.661 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.661 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.661 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:40.661 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.661 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.661 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:40.661 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.661 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.661 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:40.662 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:40.662 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:40.662 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:40.662 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:40.662 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.662 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.662 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:40.662 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:40.662 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:40.662 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:40.662 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:40.662 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.662 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.663 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:40.663 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:40.663 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:40.663 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:40.663 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:40.663 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.663 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.663 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:40.663 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:40.663 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:40.664 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:40.664 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:40.664 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.664 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.664 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:40.664 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.664 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.664 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:40.664 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.664 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.664 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:40.664 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:40.664 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:40.665 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:40.665 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:40.665 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.665 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.665 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:40.665 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:40.665 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:40.665 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:40.665 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:40.665 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.665 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.665 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:40.666 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:40.666 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:40.666 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:40.666 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:40.666 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.666 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.666 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:04:40.666 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:04:40.666 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:04:40.666 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:04:40.666 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:04:40.666 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.666 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.666 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:40.666 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:04:40.667 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:04:40.667 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:04:40.667 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:04:40.667 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:04:40.667 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:04:40.667 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:04:40.667 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 4 2024-09-18T13:04:40.667 INFO:tasks.workunit.client.0.smithi178.stdout:read: 4 2024-09-18T13:04:40.667 INFO:tasks.workunit.client.0.smithi178.stdout:read: 4 2024-09-18T13:04:40.667 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS1 (61499 ms) 2024-09-18T13:04:40.667 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS2 2024-09-18T13:04:40.667 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:05:15.044 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:05:15.045 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:05:15.045 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:05:15.045 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:05:15.045 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:05:15.045 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.045 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:05:15.045 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.045 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.045 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:05:15.045 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.046 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:05:15.046 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.046 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.046 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:05:15.046 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.046 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:05:15.046 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.046 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.046 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:05:15.046 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.046 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:05:15.046 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.047 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.047 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:05:15.047 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.047 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:05:15.047 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.047 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.047 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:05:15.047 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:05:15.047 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:05:15.047 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:05:15.047 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:05:15.047 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:05:15.047 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:05:15.048 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:05:15.048 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:05:15.048 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:05:15.048 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:05:15.048 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.048 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:05:15.048 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.048 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.048 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:05:15.048 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.048 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:05:15.048 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.048 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.049 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:05:15.049 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.049 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:05:15.049 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.049 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.049 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:05:15.049 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.049 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:05:15.049 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.049 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.049 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:05:15.049 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.050 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:05:15.050 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.050 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.050 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:05:15.050 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:05:15.050 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:05:15.050 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:05:15.050 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:05:15.050 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:05:15.050 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.050 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:05:15.050 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:05:15.050 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:05:15.050 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.050 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:05:15.051 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:05:15.051 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:05:15.051 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.051 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:05:15.051 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:05:15.051 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:05:15.051 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.051 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:05:15.051 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:05:15.051 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:05:15.051 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.051 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:05:15.051 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:05:15.052 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:05:15.052 INFO:tasks.workunit.client.0.smithi178.stdout:discard: 512~512 = 512 2024-09-18T13:05:15.052 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.052 INFO:tasks.workunit.client.0.smithi178.stdout:aio discard: 1536~512 = 0 2024-09-18T13:05:15.052 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:05:15.052 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:05:15.052 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:05:15.052 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:05:15.052 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:05:15.052 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 0 2024-09-18T13:05:15.052 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.052 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.052 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 0 2024-09-18T13:05:15.052 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.053 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.053 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 16384 2024-09-18T13:05:15.053 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.053 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.053 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 16384 2024-09-18T13:05:15.053 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.053 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.053 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:15.053 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:15.053 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 49152 2024-09-18T13:05:15.053 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.053 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.053 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 49152 2024-09-18T13:05:15.054 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.054 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.054 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 65536 2024-09-18T13:05:15.054 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.054 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.054 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 65536 2024-09-18T13:05:15.054 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.054 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.054 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:15.054 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:15.054 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 98304 2024-09-18T13:05:15.054 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.054 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.055 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 98304 2024-09-18T13:05:15.055 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.055 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.055 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 114688 2024-09-18T13:05:15.055 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.055 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.055 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 114688 2024-09-18T13:05:15.055 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.055 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.055 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:15.055 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:15.055 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 147456 2024-09-18T13:05:15.055 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.056 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.056 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 147456 2024-09-18T13:05:15.056 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.056 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.056 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 163840 2024-09-18T13:05:15.056 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.056 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.056 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 163840 2024-09-18T13:05:15.056 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.056 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.056 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:15.056 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:15.056 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 196608 2024-09-18T13:05:15.057 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.057 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.057 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 196608 2024-09-18T13:05:15.057 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.057 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.057 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 212992 2024-09-18T13:05:15.057 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.057 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.057 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 212992 2024-09-18T13:05:15.057 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.057 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.057 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:15.057 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:15.057 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.058 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:15.058 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.058 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.058 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:15.058 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.058 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.058 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.058 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:15.058 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.058 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.058 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:15.058 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.058 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.059 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.059 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:15.059 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.059 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.059 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:15.059 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.059 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.059 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.059 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:15.059 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.059 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.059 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:15.060 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.060 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.060 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.060 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:15.060 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:15.060 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.060 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:15.060 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:15.060 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.060 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:15.060 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.060 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.060 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:15.061 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.061 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.061 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:15.061 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:15.061 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:15.061 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:15.061 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:15.061 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:15.061 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:15.061 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.411 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.412 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:42.412 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:42.412 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:42.412 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:42.412 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:42.412 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.412 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.412 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:42.412 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:42.412 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:42.413 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:42.413 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:42.413 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.413 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.413 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:42.413 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.413 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.413 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:42.413 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.413 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.413 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:42.413 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:42.413 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:42.414 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:42.414 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:42.414 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.414 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.414 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:42.414 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:42.414 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:42.414 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:42.414 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:42.414 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.414 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.414 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:42.414 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:42.414 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:42.415 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:42.415 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:42.415 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.415 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.415 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:42.415 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:42.415 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:42.415 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:42.415 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:42.415 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.415 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.415 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:42.415 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.415 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.416 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:42.416 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.416 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.416 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:42.416 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:42.416 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:42.416 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:42.416 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:42.416 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.416 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.416 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:42.416 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:42.416 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:42.417 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:42.417 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:42.417 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.417 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.417 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:42.417 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:42.417 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:42.417 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:42.417 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:42.417 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.417 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.418 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:42.418 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:42.418 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:42.418 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:42.418 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:42.418 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.418 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.418 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:42.418 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.418 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.418 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:42.418 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.418 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.419 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:42.419 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:42.419 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:42.419 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:42.419 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:42.419 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.419 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.419 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:42.419 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:42.419 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:42.419 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:42.419 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:42.419 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.420 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.420 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:42.420 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:42.420 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:42.420 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:42.420 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:42.420 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.420 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.420 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:05:42.420 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:05:42.420 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:05:42.420 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:05:42.420 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:05:42.421 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.421 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.421 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:42.421 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:05:42.421 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:05:42.421 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:05:42.421 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:05:42.421 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:05:42.421 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:05:42.421 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:05:42.421 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 4 2024-09-18T13:05:42.421 INFO:tasks.workunit.client.0.smithi178.stdout:read: 4 2024-09-18T13:05:42.421 INFO:tasks.workunit.client.0.smithi178.stdout:read: 4 2024-09-18T13:05:42.422 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS2 (61754 ms) 2024-09-18T13:05:42.422 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCloneEncryption 2024-09-18T13:05:42.422 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:06:47.931 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 4 2024-09-18T13:06:47.932 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 4 2024-09-18T13:06:47.932 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 4 2024-09-18T13:06:47.932 INFO:tasks.workunit.client.0.smithi178.stdout:read: 4 2024-09-18T13:06:47.932 INFO:tasks.workunit.client.0.smithi178.stdout:read: 4 2024-09-18T13:06:47.932 INFO:tasks.workunit.client.0.smithi178.stdout:read: 4 2024-09-18T13:06:47.932 INFO:tasks.workunit.client.0.smithi178.stdout:read: 4 2024-09-18T13:06:47.932 INFO:tasks.workunit.client.0.smithi178.stdout:read: 4 2024-09-18T13:06:47.932 INFO:tasks.workunit.client.0.smithi178.stdout:read: 4 2024-09-18T13:06:47.932 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCloneEncryption (65520 ms) 2024-09-18T13:06:47.932 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.LUKS1UnderLUKS2WithoutResize 2024-09-18T13:06:47.933 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:07:04.752 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.LUKS1UnderLUKS2WithoutResize (16822 ms) 2024-09-18T13:07:04.753 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.LUKS2UnderLUKS1WithoutResize 2024-09-18T13:07:04.753 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:07:19.349 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.LUKS2UnderLUKS1WithoutResize (14596 ms) 2024-09-18T13:07:19.349 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.EncryptionFormatNoData 2024-09-18T13:07:19.349 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:07:24.201 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.EncryptionFormatNoData (4852 ms) 2024-09-18T13:07:24.201 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadSize 2024-09-18T13:07:24.201 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:07:30.520 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.EncryptionLoadBadSize (6320 ms) 2024-09-18T13:07:30.520 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-18T13:07:30.520 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/test_librbd.cc:2905: Skipped 2024-09-18T13:07:30.521 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:07:30.521 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern (0 ms) 2024-09-18T13:07:30.521 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.EncryptionLoadFormatMismatch 2024-09-18T13:07:30.521 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:09:37.508 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.EncryptionLoadFormatMismatch (126987 ms) 2024-09-18T13:09:37.508 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.EncryptedResize 2024-09-18T13:09:37.508 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:09:51.088 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.EncryptedResize (13580 ms) 2024-09-18T13:09:51.088 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.EncryptedFlattenSmallData 2024-09-18T13:09:51.088 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:10:06.665 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.EncryptedFlattenSmallData (15577 ms) 2024-09-18T13:10:06.665 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestIOWithIOHint 2024-09-18T13:10:06.665 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:10:36.213 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:10:36.213 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:10:36.214 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:10:36.214 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:10:36.214 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:10:36.214 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.214 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:10:36.214 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.214 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.214 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:10:36.214 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.214 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:10:36.214 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.214 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.214 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:10:36.214 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.215 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:10:36.215 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.215 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.215 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:10:36.215 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.215 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:10:36.215 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.215 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.215 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:10:36.215 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.215 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:10:36.215 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.215 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.216 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:10:36.216 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:10:36.216 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:10:36.216 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:10:36.216 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:10:36.216 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:10:36.216 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:10:36.217 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:10:36.217 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:10:36.217 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:10:36.217 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:10:36.217 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.217 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:10:36.217 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.217 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.217 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:10:36.217 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.217 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:10:36.218 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.218 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.218 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:10:36.218 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.218 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:10:36.218 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.218 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.218 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:10:36.218 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.218 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:10:36.219 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.219 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.219 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:10:36.219 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.219 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:10:36.219 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.219 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.219 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:10:36.219 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:10:36.219 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:10:36.219 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:10:36.219 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:10:36.219 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:10:36.220 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.220 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:10:36.220 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:10:36.220 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:10:36.220 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.220 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:10:36.220 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:10:36.220 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:10:36.220 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.220 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:10:36.220 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:10:36.220 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:10:36.221 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.221 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:10:36.221 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:10:36.221 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:10:36.221 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.221 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:10:36.221 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:10:36.221 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:10:36.221 INFO:tasks.workunit.client.0.smithi178.stdout:discard: 512~512 = 512 2024-09-18T13:10:36.221 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.221 INFO:tasks.workunit.client.0.smithi178.stdout:aio discard: 1536~512 = 0 2024-09-18T13:10:36.221 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:10:36.221 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:10:36.222 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:10:36.222 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:10:36.222 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:10:36.222 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 0 2024-09-18T13:10:36.222 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.222 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.222 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 0 2024-09-18T13:10:36.222 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.222 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.222 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 16384 2024-09-18T13:10:36.222 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.222 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.223 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 16384 2024-09-18T13:10:36.223 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.223 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.223 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:10:36.223 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:10:36.223 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 49152 2024-09-18T13:10:36.223 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.223 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.223 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 49152 2024-09-18T13:10:36.223 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.223 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.224 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 65536 2024-09-18T13:10:36.224 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.224 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.224 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 65536 2024-09-18T13:10:36.224 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.224 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.224 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:10:36.224 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:10:36.224 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 98304 2024-09-18T13:10:36.224 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.224 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.225 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 98304 2024-09-18T13:10:36.225 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.225 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.225 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 114688 2024-09-18T13:10:36.225 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.225 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.225 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 114688 2024-09-18T13:10:36.225 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.225 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.225 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:10:36.225 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:10:36.225 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 147456 2024-09-18T13:10:36.225 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.226 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.226 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 147456 2024-09-18T13:10:36.226 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.226 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.226 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 163840 2024-09-18T13:10:36.226 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.226 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.226 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 163840 2024-09-18T13:10:36.226 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.226 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.226 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:10:36.226 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:10:36.226 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 196608 2024-09-18T13:10:36.227 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.227 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.227 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 196608 2024-09-18T13:10:36.227 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.227 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.227 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 212992 2024-09-18T13:10:36.227 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.227 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.227 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 212992 2024-09-18T13:10:36.228 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.228 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.228 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:10:36.228 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:10:36.228 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.228 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:10:36.228 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.228 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.228 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:10:36.228 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.228 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.228 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.228 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:10:36.229 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.229 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.229 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:10:36.229 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.229 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.229 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.229 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:10:36.229 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.229 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.229 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:10:36.229 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.229 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.229 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.229 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:10:36.230 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.230 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.230 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:10:36.230 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.230 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.230 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.230 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:10:36.230 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:10:36.230 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.230 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:10:36.230 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:10:36.231 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.231 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:10:36.231 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.231 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.231 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:10:36.231 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.231 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.231 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:10:36.231 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:10:36.231 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:10:36.232 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:10:36.232 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:10:36.232 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:10:36.232 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:10:36.232 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.497 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.497 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:01.497 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:01.497 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:01.497 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:01.497 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:01.497 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.497 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.497 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:01.497 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:01.498 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:01.498 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:01.498 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:01.498 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.498 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.498 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:01.498 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.498 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.498 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:01.498 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.498 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.498 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:01.498 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:01.499 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:01.499 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:01.499 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:01.499 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.499 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.499 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:01.499 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:01.499 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:01.499 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:01.499 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:01.499 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.499 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.499 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:01.499 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:01.500 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:01.500 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:01.500 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:01.500 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.500 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.500 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:01.500 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:01.500 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:01.500 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:01.500 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:01.500 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.501 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.501 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:01.501 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.501 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.501 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:01.501 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.501 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.501 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:01.501 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:01.501 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:01.501 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:01.501 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:01.501 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.502 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.502 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:01.502 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:01.502 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:01.502 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:01.502 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:01.502 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.502 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.502 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:01.502 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:01.502 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:01.502 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:01.502 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:01.503 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.503 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.503 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:01.503 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:01.503 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:01.503 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:01.503 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:01.503 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.503 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.503 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:01.503 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.503 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.503 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:01.503 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.504 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.504 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:01.504 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:01.504 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:01.504 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:01.504 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:01.504 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.504 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.504 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:01.504 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:01.504 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:01.504 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:01.504 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:01.504 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.504 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.505 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:01.505 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:01.505 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:01.505 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:01.505 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:01.505 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.505 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.505 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:01.505 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:01.505 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:01.505 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:01.505 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:01.506 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.506 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.506 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:01.506 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:01.506 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:01.506 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:01.506 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:01.506 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:01.506 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:01.506 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestIOWithIOHint (54832 ms) 2024-09-18T13:11:01.506 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestDataPoolIO 2024-09-18T13:11:02.793 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:05.595 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:05.595 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:05.595 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:05.595 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:05.595 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:05.595 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:05.595 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:11:05.595 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:05.595 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:05.595 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:11:05.596 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:05.596 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:11:05.596 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:05.596 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:05.596 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:11:05.596 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:05.596 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:11:05.596 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:05.596 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:05.596 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:11:05.596 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:05.596 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:11:05.596 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:05.596 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:05.596 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:11:05.597 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:05.597 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:11:05.597 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:05.597 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:05.597 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:11:05.597 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:05.597 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:05.597 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:05.597 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:05.597 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:05.597 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:05.597 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:11:05.597 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:05.598 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:11:05.598 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:05.598 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:11:05.598 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:05.598 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:11:05.598 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:05.598 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:11:05.598 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:05.598 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:11:05.598 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:05.598 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:11:05.598 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:05.598 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:11:05.598 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:05.598 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:11:05.599 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:05.599 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:11:05.599 INFO:tasks.workunit.client.0.smithi178.stdout:discard: 512~512 = 512 2024-09-18T13:11:05.599 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:05.599 INFO:tasks.workunit.client.0.smithi178.stdout:aio discard: 1536~512 = 0 2024-09-18T13:11:05.599 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:05.599 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:05.599 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:05.599 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:05.599 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:05.599 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:05.599 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:05.599 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestDataPoolIO (4098 ms) 2024-09-18T13:11:05.599 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatch 2024-09-18T13:11:05.599 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:05.899 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatch (305 ms) 2024-09-18T13:11:05.900 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatch 2024-09-18T13:11:05.900 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:06.410 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatch (510 ms) 2024-09-18T13:11:06.410 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccess 2024-09-18T13:11:06.410 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:06.719 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccess (310 ms) 2024-09-18T13:11:06.720 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccess 2024-09-18T13:11:06.720 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:07.010 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccess (291 ms) 2024-09-18T13:11:07.011 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned 2024-09-18T13:11:07.011 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:07.513 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned (503 ms) 2024-09-18T13:11:07.513 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned 2024-09-18T13:11:07.514 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:07.899 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned (385 ms) 2024-09-18T13:11:07.922 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLarge 2024-09-18T13:11:07.922 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:08.423 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLarge (524 ms) 2024-09-18T13:11:08.423 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLarge 2024-09-18T13:11:08.423 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:08.810 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLarge (387 ms) 2024-09-18T13:11:08.810 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess 2024-09-18T13:11:08.810 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:11.310 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess (2500 ms) 2024-09-18T13:11:11.310 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess 2024-09-18T13:11:11.310 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:13.860 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess (2551 ms) 2024-09-18T13:11:13.860 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers 2024-09-18T13:11:13.860 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:14.270 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers (410 ms) 2024-09-18T13:11:14.270 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVMismatch 2024-09-18T13:11:14.270 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:14.626 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVMismatch (356 ms) 2024-09-18T13:11:14.627 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVSuccess 2024-09-18T13:11:14.627 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:14.923 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVSuccess (297 ms) 2024-09-18T13:11:14.923 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestScatterGatherIO 2024-09-18T13:11:14.923 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:15.300 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestScatterGatherIO (377 ms) 2024-09-18T13:11:15.300 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestEmptyDiscard 2024-09-18T13:11:15.300 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:15.566 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:15.566 INFO:tasks.workunit.client.0.smithi178.stdout:aio discard: 0~1048576 = 0 2024-09-18T13:11:15.567 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:15.567 INFO:tasks.workunit.client.0.smithi178.stdout:aio discard: 0~4194304 = 0 2024-09-18T13:11:15.567 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:15.567 INFO:tasks.workunit.client.0.smithi178.stdout:aio discard: 3145728~1048576 = 0 2024-09-18T13:11:15.567 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestEmptyDiscard (266 ms) 2024-09-18T13:11:15.567 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestFUA 2024-09-18T13:11:15.567 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:16.952 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:16.952 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:16.952 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:16.952 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:16.952 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:16.952 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:16.953 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:16.953 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:16.953 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:16.953 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:16.953 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:16.953 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:11:16.953 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:16.953 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:16.953 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:11:16.953 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:16.953 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:11:16.953 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:16.953 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:16.953 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:11:16.953 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:16.954 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:11:16.954 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:16.954 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:16.954 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:11:16.954 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:16.954 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:11:16.954 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:16.954 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:16.954 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:11:16.954 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:16.954 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:11:16.954 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:16.954 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:16.954 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:11:16.954 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:16.955 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:11:16.955 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:16.955 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:11:16.955 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:16.955 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:11:16.955 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:16.955 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:11:16.955 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:16.955 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:11:16.955 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:16.955 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:11:16.955 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:16.955 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:11:16.955 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:16.956 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:11:16.956 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:16.956 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:11:16.956 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:16.956 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:11:16.956 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestFUA (1385 ms) 2024-09-18T13:11:16.956 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestIOPP 2024-09-18T13:11:16.956 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:17.150 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:17.151 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:17.151 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:17.151 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:17.151 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:11:17.151 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:17.151 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:11:17.151 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:17.151 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:17.151 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:11:17.151 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:17.152 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:11:17.152 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:17.152 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:17.152 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:11:17.152 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:17.152 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:11:17.152 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:17.152 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:17.152 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:11:17.152 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:17.152 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:11:17.152 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:17.152 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:17.152 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:11:17.153 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:17.153 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:11:17.153 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:17.339 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:17.339 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:11:17.339 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:11:17.339 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:11:17.339 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:11:17.339 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:11:17.339 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:11:17.339 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:11:17.339 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:11:17.340 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:11:17.340 INFO:tasks.workunit.client.0.smithi178.stdout:start compare and write 2024-09-18T13:11:17.340 INFO:tasks.workunit.client.0.smithi178.stdout:compare and wrote: 512 2024-09-18T13:11:17.340 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:17.340 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:11:17.340 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:17.353 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:17.353 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:11:17.353 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:17.353 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:11:17.353 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:17.372 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:17.372 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:11:17.372 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:17.372 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:11:17.372 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:17.389 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:17.389 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:11:17.389 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:17.389 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:11:17.389 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:17.405 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:17.405 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:11:17.405 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:17.405 INFO:tasks.workunit.client.0.smithi178.stdout:started aio compare and write 2024-09-18T13:11:17.405 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:17.433 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:17.433 INFO:tasks.workunit.client.0.smithi178.stdout:finished aio compare and write 2024-09-18T13:11:17.433 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:17.433 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:17.433 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:17.433 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:17.433 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:17.433 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:17.434 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:11:17.434 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:17.437 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:11:17.437 INFO:tasks.workunit.client.0.smithi178.stdout:finished read 2024-09-18T13:11:17.438 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:17.438 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:11:17.438 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:17.441 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:11:17.441 INFO:tasks.workunit.client.0.smithi178.stdout:finished read 2024-09-18T13:11:17.441 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:17.441 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:11:17.441 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:17.445 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:11:17.445 INFO:tasks.workunit.client.0.smithi178.stdout:finished read 2024-09-18T13:11:17.445 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:17.445 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:11:17.445 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:17.449 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:11:17.449 INFO:tasks.workunit.client.0.smithi178.stdout:finished read 2024-09-18T13:11:17.449 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:17.449 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:11:17.450 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:11:17.450 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:11:17.450 INFO:tasks.workunit.client.0.smithi178.stdout:finished read 2024-09-18T13:11:17.450 INFO:tasks.workunit.client.0.smithi178.stdout:discard: 512~512 2024-09-18T13:11:17.450 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:36.387 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:36.387 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:36.387 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:36.387 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:36.387 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:11:36.387 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 0 2024-09-18T13:11:36.387 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.387 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.387 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 0 2024-09-18T13:11:36.388 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.388 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.388 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 16384 2024-09-18T13:11:36.388 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.388 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.388 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 16384 2024-09-18T13:11:36.388 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.388 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.388 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:36.388 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:36.388 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 49152 2024-09-18T13:11:36.388 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.388 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.389 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 49152 2024-09-18T13:11:36.389 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.389 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.389 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 65536 2024-09-18T13:11:36.389 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.389 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.389 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 65536 2024-09-18T13:11:36.389 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.389 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.389 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:36.389 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:36.389 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 98304 2024-09-18T13:11:36.389 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.390 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.390 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 98304 2024-09-18T13:11:36.390 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.390 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.390 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 114688 2024-09-18T13:11:36.390 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.390 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.390 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 114688 2024-09-18T13:11:36.390 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.390 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.390 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:36.390 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:36.390 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 147456 2024-09-18T13:11:36.391 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.391 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.391 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 147456 2024-09-18T13:11:36.391 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.391 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.391 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 163840 2024-09-18T13:11:36.391 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.391 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.391 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 163840 2024-09-18T13:11:36.391 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.391 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.391 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:36.391 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:36.392 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 196608 2024-09-18T13:11:36.392 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.392 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.392 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 196608 2024-09-18T13:11:36.392 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.392 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.392 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 212992 2024-09-18T13:11:36.392 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.392 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.392 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 212992 2024-09-18T13:11:36.392 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.392 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.392 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:36.393 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:36.393 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:36.393 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:36.393 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:36.393 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:36.393 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:36.393 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.393 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.393 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:36.393 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:36.393 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:36.393 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:36.393 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:36.393 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.394 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.394 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:36.394 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:36.394 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:36.542 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:36.542 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:36.542 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.542 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.542 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:36.542 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:36.542 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:36.673 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:36.673 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:36.673 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:36.673 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:36.673 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:36.673 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:36.674 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:36.674 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:36.674 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:36.674 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:36.674 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:36.674 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:36.674 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:37.131 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:37.131 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:37.131 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:37.131 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:37.131 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:37.131 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:37.131 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:37.510 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:37.511 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:37.511 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:37.511 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:37.511 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:37.511 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:37.511 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:38.159 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:38.160 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:38.160 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:38.160 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:38.160 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:38.160 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:38.160 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:38.770 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:38.770 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:38.770 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:38.770 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:38.770 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:38.770 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:38.770 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:38.770 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:38.771 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:38.771 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:38.771 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:38.771 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:38.771 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:39.691 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:39.691 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:39.691 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:39.691 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:39.691 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:39.691 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:39.691 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:40.561 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:40.561 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:40.561 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:40.561 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:40.561 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:40.561 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:40.561 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:41.569 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:41.569 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:41.569 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:41.569 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:41.569 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:41.569 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:41.569 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:42.502 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:42.502 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:42.502 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:42.502 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:42.502 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:42.503 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:42.503 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:42.503 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:42.503 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:42.503 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:42.503 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:42.503 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:42.503 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:43.940 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:43.940 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:43.940 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:43.940 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:43.940 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:43.940 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:43.940 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:45.112 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:45.112 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:45.112 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:45.112 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:45.112 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:45.112 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:45.112 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:46.729 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:46.729 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:46.729 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:46.730 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:46.730 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:46.730 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:46.730 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:48.021 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:48.021 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:48.022 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:48.022 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:48.022 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:48.022 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:48.022 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:48.022 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:48.022 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:48.022 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:48.022 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:48.022 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:48.022 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:49.961 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:49.961 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:49.961 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:49.961 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:49.962 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:49.962 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:49.962 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:51.575 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:51.575 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:51.575 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:51.575 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:51.575 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:51.575 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:51.575 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:53.544 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:53.544 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:53.545 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:53.545 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:53.545 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:53.545 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:53.545 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:55.447 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:11:55.448 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:11:55.448 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:11:55.448 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:11:55.448 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:55.448 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:55.448 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:55.448 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:11:55.448 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:11:55.448 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:11:55.448 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestIOPP (38496 ms) 2024-09-18T13:11:55.448 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP 2024-09-18T13:11:55.449 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:55.720 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP (273 ms) 2024-09-18T13:11:55.720 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP 2024-09-18T13:11:55.720 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:56.001 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP (280 ms) 2024-09-18T13:11:56.001 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP 2024-09-18T13:11:56.001 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:56.454 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP (453 ms) 2024-09-18T13:11:56.454 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP 2024-09-18T13:11:56.454 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:56.747 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP (294 ms) 2024-09-18T13:11:56.747 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchPP 2024-09-18T13:11:56.747 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:57.039 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchPP (292 ms) 2024-09-18T13:11:57.040 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchPP 2024-09-18T13:11:57.040 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:57.277 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:57.332 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchPP (292 ms) 2024-09-18T13:11:57.332 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-18T13:11:57.332 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:57.633 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP (301 ms) 2024-09-18T13:11:57.633 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-18T13:11:57.633 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:57.868 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:57.922 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP (289 ms) 2024-09-18T13:11:57.922 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessPP 2024-09-18T13:11:57.922 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:58.280 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessPP (359 ms) 2024-09-18T13:11:58.280 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessPP 2024-09-18T13:11:58.280 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:58.530 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:58.587 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessPP (307 ms) 2024-09-18T13:11:58.588 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-18T13:11:58.588 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:58.901 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP (313 ms) 2024-09-18T13:11:58.901 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-18T13:11:58.901 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:59.190 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:11:59.259 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP (359 ms) 2024-09-18T13:11:59.260 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP 2024-09-18T13:11:59.260 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:11:59.695 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP (435 ms) 2024-09-18T13:11:59.695 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP 2024-09-18T13:11:59.695 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:12:00.015 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:00.105 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP (411 ms) 2024-09-18T13:12:00.106 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLargePP 2024-09-18T13:12:00.106 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:12:00.539 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLargePP (433 ms) 2024-09-18T13:12:00.539 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLargePP 2024-09-18T13:12:00.539 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:12:00.846 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:00.925 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLargePP (387 ms) 2024-09-18T13:12:00.925 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP 2024-09-18T13:12:00.925 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:12:03.475 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP (2549 ms) 2024-09-18T13:12:03.475 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP 2024-09-18T13:12:03.475 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:12:05.864 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:05.954 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP (2480 ms) 2024-09-18T13:12:05.955 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestIOPPWithIOHint 2024-09-18T13:12:05.955 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:12:06.338 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:12:06.339 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:12:06.339 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:12:06.339 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:12:06.339 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:12:06.339 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:06.339 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:12:06.339 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:06.353 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:06.353 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:12:06.353 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:06.353 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:12:06.353 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:06.365 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:06.365 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:12:06.365 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:06.365 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:12:06.365 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:06.379 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:06.380 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:12:06.380 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:06.380 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:12:06.380 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:06.393 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:06.393 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:12:06.393 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:06.393 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:12:06.393 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:06.402 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:06.402 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:12:06.402 INFO:tasks.workunit.client.0.smithi178.stdout:read: 512 2024-09-18T13:12:06.402 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:06.402 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:12:06.402 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:12:06.406 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:12:06.406 INFO:tasks.workunit.client.0.smithi178.stdout:finished read 2024-09-18T13:12:06.406 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:06.406 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:12:06.406 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:12:06.410 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:12:06.410 INFO:tasks.workunit.client.0.smithi178.stdout:finished read 2024-09-18T13:12:06.410 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:06.411 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:12:06.411 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:12:06.415 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:12:06.415 INFO:tasks.workunit.client.0.smithi178.stdout:finished read 2024-09-18T13:12:06.415 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:06.415 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:12:06.415 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:12:06.419 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:12:06.419 INFO:tasks.workunit.client.0.smithi178.stdout:finished read 2024-09-18T13:12:06.419 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:06.419 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:12:06.419 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:12:25.360 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:12:25.361 INFO:tasks.workunit.client.0.smithi178.stdout:finished read 2024-09-18T13:12:25.361 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 0 2024-09-18T13:12:25.361 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.361 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.361 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 0 2024-09-18T13:12:25.361 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.361 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.361 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 16384 2024-09-18T13:12:25.361 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.361 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.361 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 16384 2024-09-18T13:12:25.361 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.362 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.362 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:25.362 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:25.362 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 49152 2024-09-18T13:12:25.362 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.362 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.362 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 49152 2024-09-18T13:12:25.362 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.362 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.362 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 65536 2024-09-18T13:12:25.362 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.362 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.362 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 65536 2024-09-18T13:12:25.362 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.362 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.363 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:25.363 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:25.363 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 98304 2024-09-18T13:12:25.363 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.363 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.363 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 98304 2024-09-18T13:12:25.363 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.363 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.363 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 114688 2024-09-18T13:12:25.363 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.363 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.363 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 114688 2024-09-18T13:12:25.363 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.364 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.364 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:25.364 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:25.364 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 147456 2024-09-18T13:12:25.364 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.364 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.364 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 147456 2024-09-18T13:12:25.364 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.364 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.364 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 163840 2024-09-18T13:12:25.364 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.364 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.364 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 163840 2024-09-18T13:12:25.364 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.365 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.365 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:25.365 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:25.365 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 196608 2024-09-18T13:12:25.365 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.365 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.365 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 196608 2024-09-18T13:12:25.365 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.365 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.365 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 212992 2024-09-18T13:12:25.365 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.365 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.365 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 212992 2024-09-18T13:12:25.365 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.366 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.366 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:25.366 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:25.366 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:25.366 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:25.366 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:25.366 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:25.366 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:25.366 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.366 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.366 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:25.366 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:25.366 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:25.375 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:25.375 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:25.375 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.375 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.375 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:25.375 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:25.375 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:25.529 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:25.529 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:25.529 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.530 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.530 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:25.530 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:25.530 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:25.670 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:25.670 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:25.670 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:25.670 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:25.670 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:25.670 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:25.670 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:25.670 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:25.670 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:25.670 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:25.671 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:25.671 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:25.671 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:26.181 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:26.182 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:26.182 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:26.182 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:26.182 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:26.182 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:26.182 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:26.654 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:26.654 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:26.654 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:26.654 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:26.654 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:26.654 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:26.654 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:27.298 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:27.299 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:27.299 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:27.299 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:27.299 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:27.299 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:27.299 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:27.827 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:27.828 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:27.828 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:27.828 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:27.828 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:27.828 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:27.828 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:27.828 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:27.828 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:27.828 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:27.828 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:27.828 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:27.828 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:28.763 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:28.763 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:28.763 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:28.764 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:28.764 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:28.764 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:28.764 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:29.504 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:29.504 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:29.504 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:29.504 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:29.504 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:29.504 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:29.505 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:30.595 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:30.596 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:30.596 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:30.596 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:30.596 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:30.596 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:30.596 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:31.531 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:31.531 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:31.531 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:31.531 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:31.532 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:31.532 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:31.532 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:31.532 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:31.532 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:31.532 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:31.532 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:31.532 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:31.532 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:32.944 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:32.944 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:32.944 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:32.944 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:32.944 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:32.945 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:32.945 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:34.122 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:34.122 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:34.123 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:34.123 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:34.123 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:34.123 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:34.123 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:35.746 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:35.746 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:35.746 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:35.746 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:35.746 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:35.746 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:35.746 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:37.069 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:37.069 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:37.069 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:37.069 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:37.070 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:37.070 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:37.070 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:37.070 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:37.070 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:37.070 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:37.070 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:37.070 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:37.070 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:39.063 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:39.064 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:39.064 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:39.064 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:39.064 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:39.064 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:39.064 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:40.644 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:40.645 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:40.645 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:40.645 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:40.645 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:40.645 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:40.645 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:42.692 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:42.693 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:42.693 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:42.693 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:42.693 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:42.693 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:42.697 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:12:44.512 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:12:44.513 INFO:tasks.workunit.client.0.smithi178.stdout:finished writesame 2024-09-18T13:12:44.513 INFO:tasks.workunit.client.0.smithi178.stdout:to verify the data 2024-09-18T13:12:44.513 INFO:tasks.workunit.client.0.smithi178.stdout:verified 2024-09-18T13:12:44.513 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:44.513 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:44.513 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:44.513 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:12:44.513 INFO:tasks.workunit.client.0.smithi178.stdout:started writesame 2024-09-18T13:12:44.513 INFO:tasks.workunit.client.0.smithi178.stdout:expected fail, finished writesame 2024-09-18T13:12:44.513 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestIOPPWithIOHint (38558 ms) 2024-09-18T13:12:44.514 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestIOToSnapshot 2024-09-18T13:12:44.514 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:12:46.429 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 0 2024-09-18T13:12:46.429 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 0 2024-09-18T13:12:46.429 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 1 2024-09-18T13:12:46.429 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 1 2024-09-18T13:12:46.429 INFO:tasks.workunit.client.0.smithi178.stdout:snap: orig 2024-09-18T13:12:46.429 INFO:tasks.workunit.client.0.smithi178.stdout:found orig with size 2097152 2024-09-18T13:12:46.430 INFO:tasks.workunit.client.0.smithi178.stdout:read: 80 2024-09-18T13:12:46.430 INFO:tasks.workunit.client.0.smithi178.stdout:write test data! 2024-09-18T13:12:46.430 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 80 2024-09-18T13:12:46.430 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 2 2024-09-18T13:12:46.430 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 2 2024-09-18T13:12:46.430 INFO:tasks.workunit.client.0.smithi178.stdout:snap: orig 2024-09-18T13:12:46.430 INFO:tasks.workunit.client.0.smithi178.stdout:snap: written 2024-09-18T13:12:46.430 INFO:tasks.workunit.client.0.smithi178.stdout:found orig with size 2097152 2024-09-18T13:12:46.430 INFO:tasks.workunit.client.0.smithi178.stdout:found written with size 2097152 2024-09-18T13:12:46.430 INFO:tasks.workunit.client.0.smithi178.stdout:read: 80 2024-09-18T13:12:46.430 INFO:tasks.workunit.client.0.smithi178.stdout:read: 80 2024-09-18T13:12:46.430 INFO:tasks.workunit.client.0.smithi178.stdout:read: 80 2024-09-18T13:12:46.430 INFO:tasks.workunit.client.0.smithi178.stdout:write to snapshot returned -30 2024-09-18T13:12:46.430 INFO:tasks.workunit.client.0.smithi178.stdout:Read-only file system 2024-09-18T13:12:46.722 INFO:tasks.workunit.client.0.smithi178.stdout:read: 80 2024-09-18T13:12:46.722 INFO:tasks.workunit.client.0.smithi178.stdout:read: 80 2024-09-18T13:12:46.722 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 80 2024-09-18T13:12:46.722 INFO:tasks.workunit.client.0.smithi178.stdout:opening testimg@orig 2024-09-18T13:12:46.722 INFO:tasks.workunit.client.0.smithi178.stdout:read: 80 2024-09-18T13:12:46.722 INFO:tasks.workunit.client.0.smithi178.stdout:write to snapshot returned -30 2024-09-18T13:12:46.723 INFO:tasks.workunit.client.0.smithi178.stdout:Read-only file system 2024-09-18T13:12:48.301 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 2 2024-09-18T13:12:48.301 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 2 2024-09-18T13:12:48.302 INFO:tasks.workunit.client.0.smithi178.stdout:snap: orig 2024-09-18T13:12:48.302 INFO:tasks.workunit.client.0.smithi178.stdout:snap: written 2024-09-18T13:12:48.302 INFO:tasks.workunit.client.0.smithi178.stdout:found orig with size 2097152 2024-09-18T13:12:48.302 INFO:tasks.workunit.client.0.smithi178.stdout:found written with size 2097152 2024-09-18T13:12:48.302 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 1 2024-09-18T13:12:48.302 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 1 2024-09-18T13:12:48.302 INFO:tasks.workunit.client.0.smithi178.stdout:snap: orig 2024-09-18T13:12:48.302 INFO:tasks.workunit.client.0.smithi178.stdout:found orig with size 2097152 2024-09-18T13:12:48.302 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 0 2024-09-18T13:12:48.302 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 0 2024-09-18T13:12:48.302 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestIOToSnapshot (3789 ms) 2024-09-18T13:12:48.302 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestSnapshotDeletedIo 2024-09-18T13:12:48.302 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:12:50.420 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestSnapshotDeletedIo (2117 ms) 2024-09-18T13:12:50.420 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestClone 2024-09-18T13:12:50.420 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:00.340 INFO:tasks.workunit.client.0.smithi178.stdout:made parent image "parent" 2024-09-18T13:13:00.340 INFO:tasks.workunit.client.0.smithi178.stdout:parent has no parent info 2024-09-18T13:13:00.340 INFO:tasks.workunit.client.0.smithi178.stdout:made snapshot "parent@parent_snap" 2024-09-18T13:13:00.341 INFO:tasks.workunit.client.0.smithi178.stdout:can't unprotect an unprotected snap 2024-09-18T13:13:00.341 INFO:tasks.workunit.client.0.smithi178.stdout:can't protect a protected snap 2024-09-18T13:13:00.341 INFO:tasks.workunit.client.0.smithi178.stdout:made and opened clone "child" 2024-09-18T13:13:00.341 INFO:tasks.workunit.client.0.smithi178.stdout:read: 8 2024-09-18T13:13:00.341 INFO:tasks.workunit.client.0.smithi178.stdout:read: 8 2024-09-18T13:13:00.341 INFO:tasks.workunit.client.0.smithi178.stdout:read: 8 2024-09-18T13:13:00.341 INFO:tasks.workunit.client.0.smithi178.stdout:sizes and overlaps are good between parent and child 2024-09-18T13:13:00.341 INFO:tasks.workunit.client.0.smithi178.stdout:child image successfully cloned all image-meta pairs 2024-09-18T13:13:00.341 INFO:tasks.workunit.client.0.smithi178.stdout:sized down clone, changed overlap 2024-09-18T13:13:00.341 INFO:tasks.workunit.client.0.smithi178.stdout:parent info: size 4194304 obj_size 4194304 parent_pool 18446744073709551615 2024-09-18T13:13:00.342 INFO:tasks.workunit.client.0.smithi178.stdout:sized up clone, changed size but not overlap or parent's size 2024-09-18T13:13:00.342 INFO:tasks.workunit.client.0.smithi178.stdout:can't remove parent while child still exists 2024-09-18T13:13:00.342 INFO:tasks.workunit.client.0.smithi178.stdout:can't remove parent while still protected 2024-09-18T13:13:00.342 INFO:tasks.workunit.client.0.smithi178.stdout:removed parent snap after unprotecting 2024-09-18T13:13:00.342 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestClone (9922 ms) 2024-09-18T13:13:00.342 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestClone2 2024-09-18T13:13:00.342 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:06.766 INFO:tasks.workunit.client.0.smithi178.stdout:made parent image "parent" 2024-09-18T13:13:06.766 INFO:tasks.workunit.client.0.smithi178.stdout:parent has no parent info 2024-09-18T13:13:06.766 INFO:tasks.workunit.client.0.smithi178.stdout:made snapshot "parent@parent_snap" 2024-09-18T13:13:06.766 INFO:tasks.workunit.client.0.smithi178.stdout:made and opened clone "child" 2024-09-18T13:13:06.766 INFO:tasks.workunit.client.0.smithi178.stdout:child image successfully cloned all image-meta pairs 2024-09-18T13:13:06.766 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestClone2 (6425 ms) 2024-09-18T13:13:06.766 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ListChildren 2024-09-18T13:13:09.918 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:22.241 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.241 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.241 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.241 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.242 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.242 INFO:tasks.workunit.client.0.smithi178.stdout:num children is: 1 2024-09-18T13:13:22.242 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 1 2024-09-18T13:13:22.242 INFO:tasks.workunit.client.0.smithi178.stdout:child: image125 2024-09-18T13:13:22.242 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image125/105c94f8083c 2024-09-18T13:13:22.242 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.242 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.242 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.242 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.242 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.242 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.242 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.242 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.242 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.242 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.243 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.243 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.243 INFO:tasks.workunit.client.0.smithi178.stdout:num children is: 2 2024-09-18T13:13:22.243 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 2 2024-09-18T13:13:22.243 INFO:tasks.workunit.client.0.smithi178.stdout:child: image126 2024-09-18T13:13:22.243 INFO:tasks.workunit.client.0.smithi178.stdout:child: image125 2024-09-18T13:13:22.243 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image125/105c94f8083c 2024-09-18T13:13:22.243 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.243 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126/105c1082bc7f 2024-09-18T13:13:22.243 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.243 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.243 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.243 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.244 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.244 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.244 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.244 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.244 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.244 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.244 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.244 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.244 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.244 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-17/image127 2024-09-18T13:13:22.244 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.244 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.244 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image127 2024-09-18T13:13:22.245 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image127 2024-09-18T13:13:22.245 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.245 INFO:tasks.workunit.client.0.smithi178.stdout:num children is: 3 2024-09-18T13:13:22.245 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 3 2024-09-18T13:13:22.245 INFO:tasks.workunit.client.0.smithi178.stdout:child: image126 2024-09-18T13:13:22.245 INFO:tasks.workunit.client.0.smithi178.stdout:child: image125 2024-09-18T13:13:22.245 INFO:tasks.workunit.client.0.smithi178.stdout:child: image127 2024-09-18T13:13:22.245 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image125/105c94f8083c 2024-09-18T13:13:22.245 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.245 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126/105c1082bc7f 2024-09-18T13:13:22.245 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.245 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image127/105c706c78df 2024-09-18T13:13:22.245 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.245 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.246 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.246 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.246 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.246 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.246 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.246 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.246 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.246 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.246 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.246 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.246 INFO:tasks.workunit.client.0.smithi178.stdout:num children is: 3 2024-09-18T13:13:22.246 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 3 2024-09-18T13:13:22.246 INFO:tasks.workunit.client.0.smithi178.stdout:child: image126 2024-09-18T13:13:22.246 INFO:tasks.workunit.client.0.smithi178.stdout:child: image125 2024-09-18T13:13:22.247 INFO:tasks.workunit.client.0.smithi178.stdout:child: image127 2024-09-18T13:13:22.247 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image125/105c94f8083c 2024-09-18T13:13:22.247 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.247 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126/105c1082bc7f 2024-09-18T13:13:22.247 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.247 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image127/105c706c78df 2024-09-18T13:13:22.247 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.247 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.247 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.247 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.247 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.247 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.247 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.247 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.248 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.248 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.248 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.248 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.248 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.248 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-17/image128 2024-09-18T13:13:22.248 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.248 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.248 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image128 2024-09-18T13:13:22.248 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image128 2024-09-18T13:13:22.248 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.248 INFO:tasks.workunit.client.0.smithi178.stdout:num children is: 4 2024-09-18T13:13:22.248 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 4 2024-09-18T13:13:22.248 INFO:tasks.workunit.client.0.smithi178.stdout:child: image126 2024-09-18T13:13:22.249 INFO:tasks.workunit.client.0.smithi178.stdout:child: image125 2024-09-18T13:13:22.249 INFO:tasks.workunit.client.0.smithi178.stdout:child: image127 2024-09-18T13:13:22.249 INFO:tasks.workunit.client.0.smithi178.stdout:child: image128 2024-09-18T13:13:22.249 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image125/105c94f8083c 2024-09-18T13:13:22.249 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.249 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126/105c1082bc7f 2024-09-18T13:13:22.249 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.249 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image127/105c706c78df 2024-09-18T13:13:22.249 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.249 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image128/105ce6e7317f 2024-09-18T13:13:22.249 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.249 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.249 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.249 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.250 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.250 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.250 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.250 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.250 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.250 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.250 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.250 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.250 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.250 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-17/image127 2024-09-18T13:13:22.250 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:22.250 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:22.250 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image127 2024-09-18T13:13:22.251 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image127 2024-09-18T13:13:22.251 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.251 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:22.251 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-17/image128 2024-09-18T13:13:22.251 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:29.972 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image125 2024-09-18T13:13:29.973 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image127 2024-09-18T13:13:29.973 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image128 2024-09-18T13:13:29.973 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image128 2024-09-18T13:13:29.973 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.973 INFO:tasks.workunit.client.0.smithi178.stdout:num children is: 4 2024-09-18T13:13:29.973 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 4 2024-09-18T13:13:29.973 INFO:tasks.workunit.client.0.smithi178.stdout:child: image126 2024-09-18T13:13:29.973 INFO:tasks.workunit.client.0.smithi178.stdout:child: image125 2024-09-18T13:13:29.973 INFO:tasks.workunit.client.0.smithi178.stdout:child: image127 2024-09-18T13:13:29.973 INFO:tasks.workunit.client.0.smithi178.stdout:child: image128 2024-09-18T13:13:29.974 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image125/105c94f8083c 2024-09-18T13:13:29.974 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.974 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126/105c1082bc7f 2024-09-18T13:13:29.974 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.974 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image127/105c706c78df 2024-09-18T13:13:29.974 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.974 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image128/105ce6e7317f 2024-09-18T13:13:29.974 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.974 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.974 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:29.974 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:29.974 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:29.974 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.974 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.975 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-17/image127 2024-09-18T13:13:29.975 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:29.975 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image127 2024-09-18T13:13:29.975 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image127 2024-09-18T13:13:29.975 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.975 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.975 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-17/image128 2024-09-18T13:13:29.975 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:29.975 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image127 2024-09-18T13:13:29.975 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image128 2024-09-18T13:13:29.975 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image128 2024-09-18T13:13:29.975 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.975 INFO:tasks.workunit.client.0.smithi178.stdout:num children is: 3 2024-09-18T13:13:29.975 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 3 2024-09-18T13:13:29.975 INFO:tasks.workunit.client.0.smithi178.stdout:child: image126 2024-09-18T13:13:29.976 INFO:tasks.workunit.client.0.smithi178.stdout:child: image127 2024-09-18T13:13:29.976 INFO:tasks.workunit.client.0.smithi178.stdout:child: image128 2024-09-18T13:13:29.976 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126/105c1082bc7f 2024-09-18T13:13:29.976 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.976 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image127/105c706c78df 2024-09-18T13:13:29.976 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.976 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image128/105ce6e7317f 2024-09-18T13:13:29.976 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.976 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.976 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:29.976 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:29.976 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:29.976 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.976 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.976 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-17/image128 2024-09-18T13:13:29.977 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:29.977 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-17/image128 2024-09-18T13:13:29.977 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image128 2024-09-18T13:13:29.977 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.977 INFO:tasks.workunit.client.0.smithi178.stdout:num children is: 2 2024-09-18T13:13:29.977 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 2 2024-09-18T13:13:29.977 INFO:tasks.workunit.client.0.smithi178.stdout:child: image126 2024-09-18T13:13:29.977 INFO:tasks.workunit.client.0.smithi178.stdout:child: image128 2024-09-18T13:13:29.977 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126/105c1082bc7f 2024-09-18T13:13:29.977 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.977 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-17/image128/105ce6e7317f 2024-09-18T13:13:29.977 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.977 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.977 INFO:tasks.workunit.client.0.smithi178.stdout:trying to find test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:29.978 INFO:tasks.workunit.client.0.smithi178.stdout:checking test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:29.978 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126 2024-09-18T13:13:29.978 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.978 INFO:tasks.workunit.client.0.smithi178.stdout:num children is: 1 2024-09-18T13:13:29.978 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 1 2024-09-18T13:13:29.978 INFO:tasks.workunit.client.0.smithi178.stdout:child: image126 2024-09-18T13:13:29.978 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-16/image126/105c1082bc7f 2024-09-18T13:13:29.978 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:13:29.978 INFO:tasks.workunit.client.0.smithi178.stdout:num children is: 0 2024-09-18T13:13:29.978 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 0 2024-09-18T13:13:29.978 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.ListChildren (23207 ms) 2024-09-18T13:13:29.978 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ListChildrenTiered 2024-09-18T13:13:29.978 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/test_librbd.cc:6995: Skipped 2024-09-18T13:13:29.978 INFO:tasks.workunit.client.0.smithi178.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:13:29.979 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered (0 ms) 2024-09-18T13:13:29.979 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.LockingPP 2024-09-18T13:13:29.979 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:30.637 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.LockingPP (664 ms) 2024-09-18T13:13:30.637 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.FlushAio 2024-09-18T13:13:30.637 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:35.032 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.FlushAio (4395 ms) 2024-09-18T13:13:35.032 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.FlushAioPP 2024-09-18T13:13:35.032 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:38.116 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.FlushAioPP (3084 ms) 2024-09-18T13:13:38.116 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ZeroLengthWrite 2024-09-18T13:13:38.116 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:38.599 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.ZeroLengthWrite (483 ms) 2024-09-18T13:13:38.599 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ZeroLengthDiscard 2024-09-18T13:13:38.599 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:38.895 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.ZeroLengthDiscard (296 ms) 2024-09-18T13:13:38.895 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ZeroLengthRead 2024-09-18T13:13:38.895 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:39.071 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.ZeroLengthRead (176 ms) 2024-09-18T13:13:39.071 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.LargeCacheRead 2024-09-18T13:13:39.071 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:39.508 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.LargeCacheRead (438 ms) 2024-09-18T13:13:39.508 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestPendingAio 2024-09-18T13:13:39.508 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:42.859 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestPendingAio (3350 ms) 2024-09-18T13:13:42.859 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyup 2024-09-18T13:13:42.859 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:45.026 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:48.557 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.CompareAndWriteCopyup (5698 ms) 2024-09-18T13:13:48.557 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-09-18T13:13:48.557 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:51.087 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:54.537 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.CompareAndWriteCopyupMismatch (5981 ms) 2024-09-18T13:13:54.537 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.Flatten 2024-09-18T13:13:54.537 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:56.219 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.Flatten (1682 ms) 2024-09-18T13:13:56.220 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.Sparsify 2024-09-18T13:13:56.220 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:56.724 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 32768 2024-09-18T13:13:56.724 INFO:tasks.workunit.client.0.smithi178.stdout:read: 32768 2024-09-18T13:13:56.724 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.Sparsify (505 ms) 2024-09-18T13:13:56.724 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.SparsifyPP 2024-09-18T13:13:56.725 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:13:57.111 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.SparsifyPP (387 ms) 2024-09-18T13:13:57.112 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.SnapshotLimit 2024-09-18T13:13:57.112 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:02.493 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.SnapshotLimit (5381 ms) 2024-09-18T13:14:02.493 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.SnapshotLimitPP 2024-09-18T13:14:02.493 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:07.333 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.SnapshotLimitPP (4841 ms) 2024-09-18T13:14:07.368 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-09-18T13:14:07.368 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:07.993 INFO:tasks.workunit.client.0.smithi178.stdout:0.00% done 2024-09-18T13:14:07.993 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.RebuildObjectMapViaLockOwner (659 ms) 2024-09-18T13:14:07.993 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.RenameViaLockOwner 2024-09-18T13:14:07.993 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:08.860 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.RenameViaLockOwner (867 ms) 2024-09-18T13:14:08.860 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.SnapCreateViaLockOwner 2024-09-18T13:14:08.860 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:10.600 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.SnapCreateViaLockOwner (1740 ms) 2024-09-18T13:14:10.600 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.SnapRemoveViaLockOwner 2024-09-18T13:14:10.600 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:12.469 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.SnapRemoveViaLockOwner (1869 ms) 2024-09-18T13:14:12.469 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-09-18T13:14:12.469 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:13.107 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.UpdateFeaturesViaLockOwner (638 ms) 2024-09-18T13:14:13.107 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-18T13:14:13.107 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/test_librbd.cc:9736: Skipped 2024-09-18T13:14:13.107 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:14:13.107 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner (0 ms) 2024-09-18T13:14:13.107 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.SnapRemove2 2024-09-18T13:14:13.107 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:16.353 INFO:tasks.workunit.client.0.smithi178.stdout:100.00% done 2024-09-18T13:14:16.353 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.SnapRemove2 (3246 ms) 2024-09-18T13:14:16.353 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.SnapRenameViaLockOwner 2024-09-18T13:14:16.353 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:17.550 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.SnapRenameViaLockOwner (1197 ms) 2024-09-18T13:14:17.550 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.SnapProtectViaLockOwner 2024-09-18T13:14:17.550 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:18.719 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.SnapProtectViaLockOwner (1169 ms) 2024-09-18T13:14:18.719 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.SnapUnprotectViaLockOwner 2024-09-18T13:14:18.719 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:20.940 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.SnapUnprotectViaLockOwner (2221 ms) 2024-09-18T13:14:20.940 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.FlattenViaLockOwner 2024-09-18T13:14:20.940 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:23.471 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.FlattenViaLockOwner (2531 ms) 2024-09-18T13:14:23.471 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ResizeViaLockOwner 2024-09-18T13:14:23.471 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:23.961 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.ResizeViaLockOwner (491 ms) 2024-09-18T13:14:23.962 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.SparsifyViaLockOwner 2024-09-18T13:14:23.962 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:24.450 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.SparsifyViaLockOwner (488 ms) 2024-09-18T13:14:24.450 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ObjectMapConsistentSnap 2024-09-18T13:14:24.450 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:44.088 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.ObjectMapConsistentSnap (19639 ms) 2024-09-18T13:14:44.088 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.Metadata 2024-09-18T13:14:44.089 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:46.623 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.Metadata (2534 ms) 2024-09-18T13:14:46.623 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.MetadataPP 2024-09-18T13:14:46.623 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:49.460 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.MetadataPP (2837 ms) 2024-09-18T13:14:49.460 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.UpdateFeatures 2024-09-18T13:14:49.460 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:51.105 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.UpdateFeatures (1645 ms) 2024-09-18T13:14:51.105 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.FeaturesBitmaskString 2024-09-18T13:14:51.105 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.FeaturesBitmaskString (0 ms) 2024-09-18T13:14:51.105 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.RebuildObjectMap 2024-09-18T13:14:51.105 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:53.152 INFO:tasks.workunit.client.0.smithi178.stdout:0.00% done 2024-09-18T13:14:53.152 INFO:tasks.workunit.client.0.smithi178.stdout:25.00% done 2024-09-18T13:14:53.152 INFO:tasks.workunit.client.0.smithi178.stdout:50.00% done 2024-09-18T13:14:53.152 INFO:tasks.workunit.client.0.smithi178.stdout:75.00% done 2024-09-18T13:14:53.152 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.RebuildObjectMap (2047 ms) 2024-09-18T13:14:53.152 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.RebuildNewObjectMap 2024-09-18T13:14:53.546 INFO:tasks.workunit.client.0.smithi178.stdout:0.00% done 2024-09-18T13:14:53.546 INFO:tasks.workunit.client.0.smithi178.stdout:25.00% done 2024-09-18T13:14:53.546 INFO:tasks.workunit.client.0.smithi178.stdout:50.00% done 2024-09-18T13:14:53.546 INFO:tasks.workunit.client.0.smithi178.stdout:75.00% done 2024-09-18T13:14:53.546 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.RebuildNewObjectMap (394 ms) 2024-09-18T13:14:53.546 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.CheckObjectMap 2024-09-18T13:14:53.546 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:55.972 INFO:tasks.workunit.client.0.smithi178.stdout:0.00% done 2024-09-18T13:14:55.972 INFO:tasks.workunit.client.0.smithi178.stdout:25.00% done 2024-09-18T13:14:55.972 INFO:tasks.workunit.client.0.smithi178.stdout:50.00% done 2024-09-18T13:14:55.972 INFO:tasks.workunit.client.0.smithi178.stdout:75.00% done 2024-09-18T13:14:55.972 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.CheckObjectMap (2426 ms) 2024-09-18T13:14:55.972 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.BlockingAIO 2024-09-18T13:14:55.972 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:56.282 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.BlockingAIO (310 ms) 2024-09-18T13:14:56.282 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ExclusiveLockTransition 2024-09-18T13:14:56.282 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:14:59.094 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.ExclusiveLockTransition (2812 ms) 2024-09-18T13:14:59.094 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ExclusiveLockReadTransition 2024-09-18T13:14:59.094 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/test_librbd.cc:10793: Skipped 2024-09-18T13:14:59.094 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:14:59.094 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition (0 ms) 2024-09-18T13:14:59.094 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.CacheMayCopyOnWrite 2024-09-18T13:14:59.094 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:01.171 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.CacheMayCopyOnWrite (2078 ms) 2024-09-18T13:15:01.172 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot 2024-09-18T13:15:01.172 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:02.632 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot (1460 ms) 2024-09-18T13:15:02.632 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestImageOptions 2024-09-18T13:15:04.985 INFO:tasks.workunit.client.0.smithi178.stdout:0.00% done 2024-09-18T13:15:04.985 INFO:tasks.workunit.client.0.smithi178.stdout:100.00% done 2024-09-18T13:15:04.985 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestImageOptions (2352 ms) 2024-09-18T13:15:04.985 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestImageOptionsPP 2024-09-18T13:15:07.606 INFO:tasks.workunit.client.0.smithi178.stdout:0.00% done 2024-09-18T13:15:07.606 INFO:tasks.workunit.client.0.smithi178.stdout:100.00% done 2024-09-18T13:15:07.607 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestImageOptionsPP (2622 ms) 2024-09-18T13:15:07.607 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.EventSocketPipe 2024-09-18T13:15:07.607 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.EventSocketPipe (0 ms) 2024-09-18T13:15:07.607 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.EventSocketEventfd 2024-09-18T13:15:07.607 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.EventSocketEventfd (0 ms) 2024-09-18T13:15:07.607 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ImagePollIO 2024-09-18T13:15:07.607 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:08.042 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:15:08.043 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:15:08.043 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:15:08.043 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:15:08.043 INFO:tasks.workunit.client.0.smithi178.stdout:wrote: 512 2024-09-18T13:15:08.043 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:15:08.043 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:15:08.043 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:15:08.043 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:15:08.043 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:15:08.043 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:15:08.043 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:15:08.043 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:15:08.044 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:15:08.044 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:15:08.044 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:15:08.044 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:15:08.044 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:15:08.044 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:15:08.044 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:15:08.044 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:15:08.044 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:15:08.044 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:15:08.044 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:15:08.044 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:15:08.044 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:15:08.045 INFO:tasks.workunit.client.0.smithi178.stdout:started write 2024-09-18T13:15:08.045 INFO:tasks.workunit.client.0.smithi178.stdout:write completion cb called! 2024-09-18T13:15:08.045 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 0 2024-09-18T13:15:08.045 INFO:tasks.workunit.client.0.smithi178.stdout:finished write 2024-09-18T13:15:08.045 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:15:08.045 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:15:08.045 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:15:08.045 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:15:08.045 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:15:08.045 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:15:08.045 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:15:08.045 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:15:08.045 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:15:08.045 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:15:08.046 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:15:08.046 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:15:08.046 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:15:08.046 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:15:08.046 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:15:08.046 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:15:08.046 INFO:tasks.workunit.client.0.smithi178.stdout:created completion 2024-09-18T13:15:08.046 INFO:tasks.workunit.client.0.smithi178.stdout:started read 2024-09-18T13:15:08.046 INFO:tasks.workunit.client.0.smithi178.stdout:read completion cb called! 2024-09-18T13:15:08.046 INFO:tasks.workunit.client.0.smithi178.stdout:return value is: 512 2024-09-18T13:15:08.046 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.ImagePollIO (437 ms) 2024-09-18T13:15:08.046 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.Mirror 2024-09-18T13:15:08.105 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:08.212 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:10.802 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.Mirror (2760 ms) 2024-09-18T13:15:10.803 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.MirrorPeerAttributes 2024-09-18T13:15:10.928 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.MirrorPeerAttributes (125 ms) 2024-09-18T13:15:10.928 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.CreateWithMirrorEnabled 2024-09-18T13:15:18.436 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.CreateWithMirrorEnabled (7509 ms) 2024-09-18T13:15:18.436 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-09-18T13:15:18.436 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:21.312 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot (2876 ms) 2024-09-18T13:15:21.312 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ExclusiveLock 2024-09-18T13:15:21.312 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:21.915 INFO:tasks.workunit.client.0.smithi178.stdout:1: acquiring exclusive lock 2024-09-18T13:15:21.915 INFO:tasks.workunit.client.0.smithi178.stdout:2: acquiring exclusive lock 2024-09-18T13:15:21.975 INFO:tasks.workunit.client.0.smithi178.stdout:2: exclusive lock acquired 2024-09-18T13:15:22.009 INFO:tasks.workunit.client.0.smithi178.stdout:2: releasing exclusive lock 2024-09-18T13:15:22.054 INFO:tasks.workunit.client.0.smithi178.stdout:2: exclusive lock released 2024-09-18T13:15:22.054 INFO:tasks.workunit.client.0.smithi178.stdout:2: acquiring exclusive lock 2024-09-18T13:15:22.116 INFO:tasks.workunit.client.0.smithi178.stdout:1: exclusive lock acquired 2024-09-18T13:15:22.118 INFO:tasks.workunit.client.0.smithi178.stdout:1: releasing exclusive lock 2024-09-18T13:15:22.161 INFO:tasks.workunit.client.0.smithi178.stdout:1: exclusive lock released 2024-09-18T13:15:22.161 INFO:tasks.workunit.client.0.smithi178.stdout:1: acquiring exclusive lock 2024-09-18T13:15:22.236 INFO:tasks.workunit.client.0.smithi178.stdout:2: exclusive lock acquired 2024-09-18T13:15:22.285 INFO:tasks.workunit.client.0.smithi178.stdout:2: releasing exclusive lock 2024-09-18T13:15:22.474 INFO:tasks.workunit.client.0.smithi178.stdout:2: exclusive lock released 2024-09-18T13:15:22.474 INFO:tasks.workunit.client.0.smithi178.stdout:2: acquiring exclusive lock 2024-09-18T13:15:22.531 INFO:tasks.workunit.client.0.smithi178.stdout:1: exclusive lock acquired 2024-09-18T13:15:22.532 INFO:tasks.workunit.client.0.smithi178.stdout:1: releasing exclusive lock 2024-09-18T13:15:22.588 INFO:tasks.workunit.client.0.smithi178.stdout:1: exclusive lock released 2024-09-18T13:15:22.588 INFO:tasks.workunit.client.0.smithi178.stdout:1: acquiring exclusive lock 2024-09-18T13:15:22.647 INFO:tasks.workunit.client.0.smithi178.stdout:2: exclusive lock acquired 2024-09-18T13:15:22.657 INFO:tasks.workunit.client.0.smithi178.stdout:2: releasing exclusive lock 2024-09-18T13:15:22.709 INFO:tasks.workunit.client.0.smithi178.stdout:2: exclusive lock released 2024-09-18T13:15:22.709 INFO:tasks.workunit.client.0.smithi178.stdout:2: acquiring exclusive lock 2024-09-18T13:15:22.770 INFO:tasks.workunit.client.0.smithi178.stdout:1: exclusive lock acquired 2024-09-18T13:15:22.812 INFO:tasks.workunit.client.0.smithi178.stdout:1: releasing exclusive lock 2024-09-18T13:15:22.862 INFO:tasks.workunit.client.0.smithi178.stdout:1: exclusive lock released 2024-09-18T13:15:22.862 INFO:tasks.workunit.client.0.smithi178.stdout:1: acquiring exclusive lock 2024-09-18T13:15:22.920 INFO:tasks.workunit.client.0.smithi178.stdout:2: exclusive lock acquired 2024-09-18T13:15:22.937 INFO:tasks.workunit.client.0.smithi178.stdout:2: releasing exclusive lock 2024-09-18T13:15:22.988 INFO:tasks.workunit.client.0.smithi178.stdout:2: exclusive lock released 2024-09-18T13:15:22.988 INFO:tasks.workunit.client.0.smithi178.stdout:2: acquiring exclusive lock 2024-09-18T13:15:23.054 INFO:tasks.workunit.client.0.smithi178.stdout:1: exclusive lock acquired 2024-09-18T13:15:23.064 INFO:tasks.workunit.client.0.smithi178.stdout:1: releasing exclusive lock 2024-09-18T13:15:23.117 INFO:tasks.workunit.client.0.smithi178.stdout:1: exclusive lock released 2024-09-18T13:15:23.117 INFO:tasks.workunit.client.0.smithi178.stdout:1: acquiring exclusive lock 2024-09-18T13:15:23.177 INFO:tasks.workunit.client.0.smithi178.stdout:2: exclusive lock acquired 2024-09-18T13:15:23.223 INFO:tasks.workunit.client.0.smithi178.stdout:2: releasing exclusive lock 2024-09-18T13:15:23.288 INFO:tasks.workunit.client.0.smithi178.stdout:2: exclusive lock released 2024-09-18T13:15:23.439 INFO:tasks.workunit.client.0.smithi178.stdout:1: exclusive lock acquired 2024-09-18T13:15:23.483 INFO:tasks.workunit.client.0.smithi178.stdout:1: releasing exclusive lock 2024-09-18T13:15:23.522 INFO:tasks.workunit.client.0.smithi178.stdout:1: exclusive lock released 2024-09-18T13:15:23.725 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.ExclusiveLock (2412 ms) 2024-09-18T13:15:23.725 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.BreakLock 2024-09-18T13:15:23.725 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/test_librbd.cc:11553: Skipped 2024-09-18T13:15:23.725 INFO:tasks.workunit.client.0.smithi178.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:15:23.725 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestLibRBD.BreakLock (0 ms) 2024-09-18T13:15:23.725 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.DiscardAfterWrite 2024-09-18T13:15:23.725 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:24.432 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.DiscardAfterWrite (707 ms) 2024-09-18T13:15:24.432 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.DefaultFeatures 2024-09-18T13:15:24.432 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.DefaultFeatures (0 ms) 2024-09-18T13:15:24.432 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurge 2024-09-18T13:15:24.433 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:25.247 INFO:tasks.workunit.client.0.smithi178.stdout:0.00% done 2024-09-18T13:15:25.248 INFO:tasks.workunit.client.0.smithi178.stdout:1.56% done 2024-09-18T13:15:25.248 INFO:tasks.workunit.client.0.smithi178.stdout:3.12% done 2024-09-18T13:15:25.248 INFO:tasks.workunit.client.0.smithi178.stdout:4.69% done 2024-09-18T13:15:25.248 INFO:tasks.workunit.client.0.smithi178.stdout:6.25% done 2024-09-18T13:15:25.248 INFO:tasks.workunit.client.0.smithi178.stdout:7.81% done 2024-09-18T13:15:25.248 INFO:tasks.workunit.client.0.smithi178.stdout:9.38% done 2024-09-18T13:15:25.248 INFO:tasks.workunit.client.0.smithi178.stdout:10.94% done 2024-09-18T13:15:25.248 INFO:tasks.workunit.client.0.smithi178.stdout:12.50% done 2024-09-18T13:15:25.248 INFO:tasks.workunit.client.0.smithi178.stdout:14.06% done 2024-09-18T13:15:25.248 INFO:tasks.workunit.client.0.smithi178.stdout:15.62% done 2024-09-18T13:15:25.248 INFO:tasks.workunit.client.0.smithi178.stdout:17.19% done 2024-09-18T13:15:25.248 INFO:tasks.workunit.client.0.smithi178.stdout:18.75% done 2024-09-18T13:15:25.249 INFO:tasks.workunit.client.0.smithi178.stdout:20.31% done 2024-09-18T13:15:25.249 INFO:tasks.workunit.client.0.smithi178.stdout:21.88% done 2024-09-18T13:15:25.249 INFO:tasks.workunit.client.0.smithi178.stdout:23.44% done 2024-09-18T13:15:25.249 INFO:tasks.workunit.client.0.smithi178.stdout:25.00% done 2024-09-18T13:15:25.249 INFO:tasks.workunit.client.0.smithi178.stdout:26.56% done 2024-09-18T13:15:25.249 INFO:tasks.workunit.client.0.smithi178.stdout:28.12% done 2024-09-18T13:15:25.249 INFO:tasks.workunit.client.0.smithi178.stdout:29.69% done 2024-09-18T13:15:25.249 INFO:tasks.workunit.client.0.smithi178.stdout:31.25% done 2024-09-18T13:15:25.249 INFO:tasks.workunit.client.0.smithi178.stdout:32.81% done 2024-09-18T13:15:25.249 INFO:tasks.workunit.client.0.smithi178.stdout:34.38% done 2024-09-18T13:15:25.249 INFO:tasks.workunit.client.0.smithi178.stdout:35.94% done 2024-09-18T13:15:25.249 INFO:tasks.workunit.client.0.smithi178.stdout:37.50% done 2024-09-18T13:15:25.249 INFO:tasks.workunit.client.0.smithi178.stdout:39.06% done 2024-09-18T13:15:25.250 INFO:tasks.workunit.client.0.smithi178.stdout:40.62% done 2024-09-18T13:15:25.250 INFO:tasks.workunit.client.0.smithi178.stdout:42.19% done 2024-09-18T13:15:25.250 INFO:tasks.workunit.client.0.smithi178.stdout:43.75% done 2024-09-18T13:15:25.250 INFO:tasks.workunit.client.0.smithi178.stdout:45.31% done 2024-09-18T13:15:25.250 INFO:tasks.workunit.client.0.smithi178.stdout:46.88% done 2024-09-18T13:15:25.250 INFO:tasks.workunit.client.0.smithi178.stdout:48.44% done 2024-09-18T13:15:25.250 INFO:tasks.workunit.client.0.smithi178.stdout:50.00% done 2024-09-18T13:15:25.250 INFO:tasks.workunit.client.0.smithi178.stdout:51.56% done 2024-09-18T13:15:25.250 INFO:tasks.workunit.client.0.smithi178.stdout:53.12% done 2024-09-18T13:15:25.250 INFO:tasks.workunit.client.0.smithi178.stdout:54.69% done 2024-09-18T13:15:25.250 INFO:tasks.workunit.client.0.smithi178.stdout:56.25% done 2024-09-18T13:15:25.250 INFO:tasks.workunit.client.0.smithi178.stdout:57.81% done 2024-09-18T13:15:25.251 INFO:tasks.workunit.client.0.smithi178.stdout:59.38% done 2024-09-18T13:15:25.251 INFO:tasks.workunit.client.0.smithi178.stdout:60.94% done 2024-09-18T13:15:25.251 INFO:tasks.workunit.client.0.smithi178.stdout:62.50% done 2024-09-18T13:15:25.251 INFO:tasks.workunit.client.0.smithi178.stdout:64.06% done 2024-09-18T13:15:25.251 INFO:tasks.workunit.client.0.smithi178.stdout:65.62% done 2024-09-18T13:15:25.251 INFO:tasks.workunit.client.0.smithi178.stdout:67.19% done 2024-09-18T13:15:25.251 INFO:tasks.workunit.client.0.smithi178.stdout:68.75% done 2024-09-18T13:15:25.251 INFO:tasks.workunit.client.0.smithi178.stdout:70.31% done 2024-09-18T13:15:25.251 INFO:tasks.workunit.client.0.smithi178.stdout:71.88% done 2024-09-18T13:15:25.251 INFO:tasks.workunit.client.0.smithi178.stdout:73.44% done 2024-09-18T13:15:25.251 INFO:tasks.workunit.client.0.smithi178.stdout:75.00% done 2024-09-18T13:15:25.251 INFO:tasks.workunit.client.0.smithi178.stdout:76.56% done 2024-09-18T13:15:25.251 INFO:tasks.workunit.client.0.smithi178.stdout:78.12% done 2024-09-18T13:15:25.252 INFO:tasks.workunit.client.0.smithi178.stdout:79.69% done 2024-09-18T13:15:25.252 INFO:tasks.workunit.client.0.smithi178.stdout:81.25% done 2024-09-18T13:15:25.252 INFO:tasks.workunit.client.0.smithi178.stdout:82.81% done 2024-09-18T13:15:25.252 INFO:tasks.workunit.client.0.smithi178.stdout:84.38% done 2024-09-18T13:15:25.252 INFO:tasks.workunit.client.0.smithi178.stdout:85.94% done 2024-09-18T13:15:25.252 INFO:tasks.workunit.client.0.smithi178.stdout:87.50% done 2024-09-18T13:15:25.252 INFO:tasks.workunit.client.0.smithi178.stdout:89.06% done 2024-09-18T13:15:25.252 INFO:tasks.workunit.client.0.smithi178.stdout:90.62% done 2024-09-18T13:15:25.252 INFO:tasks.workunit.client.0.smithi178.stdout:92.19% done 2024-09-18T13:15:25.252 INFO:tasks.workunit.client.0.smithi178.stdout:93.75% done 2024-09-18T13:15:25.252 INFO:tasks.workunit.client.0.smithi178.stdout:95.31% done 2024-09-18T13:15:25.252 INFO:tasks.workunit.client.0.smithi178.stdout:96.88% done 2024-09-18T13:15:25.253 INFO:tasks.workunit.client.0.smithi178.stdout:98.44% done 2024-09-18T13:15:25.253 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestTrashMoveAndPurge (816 ms) 2024-09-18T13:15:25.253 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-09-18T13:15:25.253 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:26.007 INFO:tasks.workunit.client.0.smithi178.stdout:0.00% done 2024-09-18T13:15:26.007 INFO:tasks.workunit.client.0.smithi178.stdout:1.56% done 2024-09-18T13:15:26.007 INFO:tasks.workunit.client.0.smithi178.stdout:3.12% done 2024-09-18T13:15:26.007 INFO:tasks.workunit.client.0.smithi178.stdout:4.69% done 2024-09-18T13:15:26.007 INFO:tasks.workunit.client.0.smithi178.stdout:6.25% done 2024-09-18T13:15:26.007 INFO:tasks.workunit.client.0.smithi178.stdout:7.81% done 2024-09-18T13:15:26.008 INFO:tasks.workunit.client.0.smithi178.stdout:9.38% done 2024-09-18T13:15:26.008 INFO:tasks.workunit.client.0.smithi178.stdout:10.94% done 2024-09-18T13:15:26.008 INFO:tasks.workunit.client.0.smithi178.stdout:12.50% done 2024-09-18T13:15:26.008 INFO:tasks.workunit.client.0.smithi178.stdout:14.06% done 2024-09-18T13:15:26.008 INFO:tasks.workunit.client.0.smithi178.stdout:15.62% done 2024-09-18T13:15:26.008 INFO:tasks.workunit.client.0.smithi178.stdout:17.19% done 2024-09-18T13:15:26.008 INFO:tasks.workunit.client.0.smithi178.stdout:18.75% done 2024-09-18T13:15:26.008 INFO:tasks.workunit.client.0.smithi178.stdout:20.31% done 2024-09-18T13:15:26.008 INFO:tasks.workunit.client.0.smithi178.stdout:21.88% done 2024-09-18T13:15:26.008 INFO:tasks.workunit.client.0.smithi178.stdout:23.44% done 2024-09-18T13:15:26.008 INFO:tasks.workunit.client.0.smithi178.stdout:25.00% done 2024-09-18T13:15:26.008 INFO:tasks.workunit.client.0.smithi178.stdout:26.56% done 2024-09-18T13:15:26.008 INFO:tasks.workunit.client.0.smithi178.stdout:28.12% done 2024-09-18T13:15:26.008 INFO:tasks.workunit.client.0.smithi178.stdout:29.69% done 2024-09-18T13:15:26.009 INFO:tasks.workunit.client.0.smithi178.stdout:31.25% done 2024-09-18T13:15:26.009 INFO:tasks.workunit.client.0.smithi178.stdout:32.81% done 2024-09-18T13:15:26.009 INFO:tasks.workunit.client.0.smithi178.stdout:34.38% done 2024-09-18T13:15:26.009 INFO:tasks.workunit.client.0.smithi178.stdout:35.94% done 2024-09-18T13:15:26.009 INFO:tasks.workunit.client.0.smithi178.stdout:37.50% done 2024-09-18T13:15:26.009 INFO:tasks.workunit.client.0.smithi178.stdout:39.06% done 2024-09-18T13:15:26.009 INFO:tasks.workunit.client.0.smithi178.stdout:40.62% done 2024-09-18T13:15:26.009 INFO:tasks.workunit.client.0.smithi178.stdout:42.19% done 2024-09-18T13:15:26.009 INFO:tasks.workunit.client.0.smithi178.stdout:43.75% done 2024-09-18T13:15:26.009 INFO:tasks.workunit.client.0.smithi178.stdout:45.31% done 2024-09-18T13:15:26.009 INFO:tasks.workunit.client.0.smithi178.stdout:46.88% done 2024-09-18T13:15:26.009 INFO:tasks.workunit.client.0.smithi178.stdout:48.44% done 2024-09-18T13:15:26.009 INFO:tasks.workunit.client.0.smithi178.stdout:50.00% done 2024-09-18T13:15:26.009 INFO:tasks.workunit.client.0.smithi178.stdout:51.56% done 2024-09-18T13:15:26.009 INFO:tasks.workunit.client.0.smithi178.stdout:53.12% done 2024-09-18T13:15:26.010 INFO:tasks.workunit.client.0.smithi178.stdout:54.69% done 2024-09-18T13:15:26.010 INFO:tasks.workunit.client.0.smithi178.stdout:56.25% done 2024-09-18T13:15:26.010 INFO:tasks.workunit.client.0.smithi178.stdout:57.81% done 2024-09-18T13:15:26.010 INFO:tasks.workunit.client.0.smithi178.stdout:59.38% done 2024-09-18T13:15:26.010 INFO:tasks.workunit.client.0.smithi178.stdout:60.94% done 2024-09-18T13:15:26.010 INFO:tasks.workunit.client.0.smithi178.stdout:62.50% done 2024-09-18T13:15:26.010 INFO:tasks.workunit.client.0.smithi178.stdout:64.06% done 2024-09-18T13:15:26.010 INFO:tasks.workunit.client.0.smithi178.stdout:65.62% done 2024-09-18T13:15:26.010 INFO:tasks.workunit.client.0.smithi178.stdout:67.19% done 2024-09-18T13:15:26.010 INFO:tasks.workunit.client.0.smithi178.stdout:68.75% done 2024-09-18T13:15:26.010 INFO:tasks.workunit.client.0.smithi178.stdout:70.31% done 2024-09-18T13:15:26.010 INFO:tasks.workunit.client.0.smithi178.stdout:71.88% done 2024-09-18T13:15:26.010 INFO:tasks.workunit.client.0.smithi178.stdout:73.44% done 2024-09-18T13:15:26.010 INFO:tasks.workunit.client.0.smithi178.stdout:75.00% done 2024-09-18T13:15:26.010 INFO:tasks.workunit.client.0.smithi178.stdout:76.56% done 2024-09-18T13:15:26.011 INFO:tasks.workunit.client.0.smithi178.stdout:78.12% done 2024-09-18T13:15:26.011 INFO:tasks.workunit.client.0.smithi178.stdout:79.69% done 2024-09-18T13:15:26.011 INFO:tasks.workunit.client.0.smithi178.stdout:81.25% done 2024-09-18T13:15:26.011 INFO:tasks.workunit.client.0.smithi178.stdout:82.81% done 2024-09-18T13:15:26.011 INFO:tasks.workunit.client.0.smithi178.stdout:84.38% done 2024-09-18T13:15:26.011 INFO:tasks.workunit.client.0.smithi178.stdout:85.94% done 2024-09-18T13:15:26.011 INFO:tasks.workunit.client.0.smithi178.stdout:87.50% done 2024-09-18T13:15:26.011 INFO:tasks.workunit.client.0.smithi178.stdout:89.06% done 2024-09-18T13:15:26.011 INFO:tasks.workunit.client.0.smithi178.stdout:90.62% done 2024-09-18T13:15:26.011 INFO:tasks.workunit.client.0.smithi178.stdout:92.19% done 2024-09-18T13:15:26.011 INFO:tasks.workunit.client.0.smithi178.stdout:93.75% done 2024-09-18T13:15:26.011 INFO:tasks.workunit.client.0.smithi178.stdout:95.31% done 2024-09-18T13:15:26.011 INFO:tasks.workunit.client.0.smithi178.stdout:96.88% done 2024-09-18T13:15:26.011 INFO:tasks.workunit.client.0.smithi178.stdout:98.44% done 2024-09-18T13:15:26.011 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay (759 ms) 2024-09-18T13:15:26.012 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestTrashPurge 2024-09-18T13:15:26.012 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:26.086 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:27.830 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestTrashPurge (1824 ms) 2024-09-18T13:15:27.830 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndRestore 2024-09-18T13:15:27.830 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:28.420 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestTrashMoveAndRestore (590 ms) 2024-09-18T13:15:28.420 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestListWatchers 2024-09-18T13:15:28.420 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:28.772 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestListWatchers (351 ms) 2024-09-18T13:15:28.772 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestSetSnapById 2024-09-18T13:15:28.772 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:30.442 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestSetSnapById (1670 ms) 2024-09-18T13:15:30.442 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.Namespaces 2024-09-18T13:15:30.733 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.Namespaces (292 ms) 2024-09-18T13:15:30.733 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.NamespacesPP 2024-09-18T13:15:31.062 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:31.094 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:32.150 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.NamespacesPP (1417 ms) 2024-09-18T13:15:32.151 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.Migration 2024-09-18T13:15:32.151 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:32.151 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:38.472 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.Migration (6322 ms) 2024-09-18T13:15:38.473 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.MigrationPP 2024-09-18T13:15:38.473 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:38.473 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:44.383 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.MigrationPP (5910 ms) 2024-09-18T13:15:44.383 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestGetAccessTimestamp 2024-09-18T13:15:44.383 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:44.557 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestGetAccessTimestamp (175 ms) 2024-09-18T13:15:44.558 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.TestGetModifyTimestamp 2024-09-18T13:15:44.558 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:44.730 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.TestGetModifyTimestamp (172 ms) 2024-09-18T13:15:44.730 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ZeroOverlapFlatten 2024-09-18T13:15:44.730 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:47.121 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.ZeroOverlapFlatten (2391 ms) 2024-09-18T13:15:47.121 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.PoolMetadata 2024-09-18T13:15:47.532 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.PoolMetadata (411 ms) 2024-09-18T13:15:47.532 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.PoolMetadataPP 2024-09-18T13:15:47.741 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.PoolMetadataPP (209 ms) 2024-09-18T13:15:47.741 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.Config 2024-09-18T13:15:47.768 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:48.257 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.Config (517 ms) 2024-09-18T13:15:48.257 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ConfigPP 2024-09-18T13:15:48.294 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:49.187 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.ConfigPP (929 ms) 2024-09-18T13:15:49.187 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.PoolStatsPP 2024-09-18T13:15:50.793 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:53.215 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:53.316 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:53.392 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:15:54.915 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.PoolStatsPP (5729 ms) 2024-09-18T13:15:54.915 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ImageSpec 2024-09-18T13:15:56.818 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:16:04.238 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.ImageSpec (9322 ms) 2024-09-18T13:16:04.238 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.SnapRemoveWithChildMissing 2024-09-18T13:16:05.850 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:16:18.453 INFO:tasks.workunit.client.0.smithi178.stdout:num children is: 3 2024-09-18T13:16:18.454 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 3 2024-09-18T13:16:18.454 INFO:tasks.workunit.client.0.smithi178.stdout:child: image224 2024-09-18T13:16:18.454 INFO:tasks.workunit.client.0.smithi178.stdout:child: image226 2024-09-18T13:16:18.454 INFO:tasks.workunit.client.0.smithi178.stdout:child: image225 2024-09-18T13:16:18.454 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-1/image224/105ca57935c0 2024-09-18T13:16:18.454 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:16:18.454 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-20/image225/105cb5392442 2024-09-18T13:16:18.454 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:16:18.454 INFO:tasks.workunit.client.0.smithi178.stdout:found child test-librbd-smithi178-30317-1/image226/105ca111c1ef 2024-09-18T13:16:18.454 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:16:18.455 INFO:tasks.workunit.client.0.smithi178.stdout:num children is: 0 2024-09-18T13:16:18.455 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 0 2024-09-18T13:16:18.455 INFO:tasks.workunit.client.0.smithi178.stdout:num snaps is: 0 2024-09-18T13:16:18.455 INFO:tasks.workunit.client.0.smithi178.stdout:expected: 0 2024-09-18T13:16:18.455 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.SnapRemoveWithChildMissing (14216 ms) 2024-09-18T13:16:18.455 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.QuiesceWatch 2024-09-18T13:16:19.891 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:16:29.389 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.QuiesceWatch (10935 ms) 2024-09-18T13:16:29.389 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.QuiesceWatchPP 2024-09-18T13:16:29.389 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:16:36.432 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.QuiesceWatchPP (7043 ms) 2024-09-18T13:16:36.432 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.QuiesceWatchError 2024-09-18T13:16:36.432 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/test_librbd.cc:13115: Skipped 2024-09-18T13:16:36.432 INFO:tasks.workunit.client.0.smithi178.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:16:36.432 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError (0 ms) 2024-09-18T13:16:36.432 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.QuiesceWatchTimeout 2024-09-18T13:16:36.432 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:16:36.657 INFO:tasks.workunit.client.0.smithi178.stderr:test quiesce is not long enough to time out 2024-09-18T13:16:45.415 INFO:tasks.workunit.client.0.smithi178.stderr:test quiesce is timed out 2024-09-18T13:16:45.463 INFO:tasks.workunit.client.0.smithi178.stderr:waiting for timed out ... 0 2024-09-18T13:16:46.463 INFO:tasks.workunit.client.0.smithi178.stderr:waiting for timed out ... 1 2024-09-18T13:16:47.463 INFO:tasks.workunit.client.0.smithi178.stderr:waiting for timed out ... 2 2024-09-18T13:16:48.464 INFO:tasks.workunit.client.0.smithi178.stderr:waiting for timed out ... 3 2024-09-18T13:16:49.464 INFO:tasks.workunit.client.0.smithi178.stderr:waiting for timed out ... 4 2024-09-18T13:16:50.464 INFO:tasks.workunit.client.0.smithi178.stderr:waiting for timed out ... 5 2024-09-18T13:16:51.464 INFO:tasks.workunit.client.0.smithi178.stderr:waiting for timed out ... 6 2024-09-18T13:16:52.464 INFO:tasks.workunit.client.0.smithi178.stderr:waiting for timed out ... 7 2024-09-18T13:16:53.464 INFO:tasks.workunit.client.0.smithi178.stderr:waiting for timed out ... 8 2024-09-18T13:16:54.464 INFO:tasks.workunit.client.0.smithi178.stderr:waiting for timed out ... 9 2024-09-18T13:16:55.465 INFO:tasks.workunit.client.0.smithi178.stderr:waiting for timed out ... 10 2024-09-18T13:17:06.465 INFO:tasks.workunit.client.0.smithi178.stderr:test retry succeeds 2024-09-18T13:17:10.025 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.QuiesceWatchTimeout (33593 ms) 2024-09-18T13:17:10.025 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.WriteZeroes 2024-09-18T13:17:10.025 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:17:10.522 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.WriteZeroes (498 ms) 2024-09-18T13:17:10.522 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.WriteZeroesThickProvision 2024-09-18T13:17:10.522 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:17:11.017 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.WriteZeroesThickProvision (495 ms) 2024-09-18T13:17:11.017 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.ConcurrentOperations 2024-09-18T13:17:11.017 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/test_librbd.cc:13474: Skipped 2024-09-18T13:17:11.017 INFO:tasks.workunit.client.0.smithi178.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:17:11.018 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations (0 ms) 2024-09-18T13:17:11.018 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestLibRBD.FormatAndCloneFormatOptions 2024-09-18T13:17:19.197 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestLibRBD.FormatAndCloneFormatOptions (8179 ms) 2024-09-18T13:17:38.812 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 171 tests from TestLibRBD (1095539 ms total) 2024-09-18T13:17:38.812 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:17:38.812 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:17:38.812 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 171 tests from 1 test suite ran. (1115203 ms total) 2024-09-18T13:17:38.812 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 164 tests. 2024-09-18T13:17:38.812 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-18T13:17:38.812 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-18T13:17:38.812 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered 2024-09-18T13:17:38.812 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-18T13:17:38.812 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition 2024-09-18T13:17:38.813 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestLibRBD.BreakLock 2024-09-18T13:17:38.813 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError 2024-09-18T13:17:38.813 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations 2024-09-18T13:17:38.813 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:17:38.813 INFO:tasks.workunit.client.0.smithi178.stdout: YOU HAVE 1 DISABLED TEST 2024-09-18T13:17:38.813 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:17:38.947 INFO:tasks.workunit.client.0.smithi178.stdout:seed 39100 2024-09-18T13:17:38.947 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = EncryptedFlattenTest/0.* 2024-09-18T13:17:38.947 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-18T13:17:38.948 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:17:38.948 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/0, where TypeParam = PlaintextUnderLUKS1 2024-09-18T13:17:39.026 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/0.Simple 2024-09-18T13:17:40.845 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:17:53.492 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/0.Simple (14467 ms) 2024-09-18T13:17:53.493 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/0.Grow 2024-09-18T13:17:53.493 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:18:04.447 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/0.Grow (10954 ms) 2024-09-18T13:18:04.447 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/0.Shrink 2024-09-18T13:18:04.447 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:18:15.467 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/0.Shrink (11020 ms) 2024-09-18T13:18:15.467 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOne 2024-09-18T13:18:15.467 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:18:25.935 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/0.ShrinkToOne (10469 ms) 2024-09-18T13:18:25.936 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot 2024-09-18T13:18:25.936 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:18:37.444 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot (11508 ms) 2024-09-18T13:18:37.444 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/0.MinOverlap 2024-09-18T13:18:37.444 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:18:48.196 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/0.MinOverlap (10752 ms) 2024-09-18T13:18:48.196 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/0.ZeroOverlap 2024-09-18T13:18:48.196 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:18:58.032 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/0.ZeroOverlap (9836 ms) 2024-09-18T13:18:58.838 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/0 (79006 ms total) 2024-09-18T13:18:58.838 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:18:58.838 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:18:58.838 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 7 tests from 1 test suite ran. (79891 ms total) 2024-09-18T13:18:58.838 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 7 tests. 2024-09-18T13:18:58.947 INFO:tasks.workunit.client.0.smithi178.stdout:seed 39188 2024-09-18T13:18:58.948 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = EncryptedFlattenTest/1.* 2024-09-18T13:18:58.948 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-18T13:18:58.948 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:18:58.948 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/1, where TypeParam = PlaintextUnderLUKS2 2024-09-18T13:18:59.026 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/1.Simple 2024-09-18T13:19:00.848 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:19:15.507 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/1.Simple (16481 ms) 2024-09-18T13:19:15.507 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/1.Grow 2024-09-18T13:19:15.507 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:19:28.366 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/1.Grow (12859 ms) 2024-09-18T13:19:28.366 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/1.Shrink 2024-09-18T13:19:28.366 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:19:41.466 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/1.Shrink (13100 ms) 2024-09-18T13:19:41.466 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOne 2024-09-18T13:19:41.466 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:19:54.152 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/1.ShrinkToOne (12686 ms) 2024-09-18T13:19:54.153 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot 2024-09-18T13:19:54.153 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:20:09.514 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot (15362 ms) 2024-09-18T13:20:09.514 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/1.MinOverlap 2024-09-18T13:20:09.514 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:20:23.936 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/1.MinOverlap (14422 ms) 2024-09-18T13:20:23.936 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/1.ZeroOverlap 2024-09-18T13:20:23.936 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:20:37.205 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/1.ZeroOverlap (13270 ms) 2024-09-18T13:20:37.852 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/1 (98180 ms total) 2024-09-18T13:20:37.852 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:20:37.852 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:20:37.853 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 7 tests from 1 test suite ran. (98905 ms total) 2024-09-18T13:20:37.853 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 7 tests. 2024-09-18T13:20:37.950 INFO:tasks.workunit.client.0.smithi178.stdout:seed 44492 2024-09-18T13:20:37.951 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = EncryptedFlattenTest/2.* 2024-09-18T13:20:37.951 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-18T13:20:37.951 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:20:37.951 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/2, where TypeParam = UnformattedLUKS1 2024-09-18T13:20:38.045 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/2.Simple 2024-09-18T13:20:39.845 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:20:55.042 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/2.Simple (16998 ms) 2024-09-18T13:20:55.043 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/2.Grow 2024-09-18T13:20:55.043 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:21:07.692 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/2.Grow (12650 ms) 2024-09-18T13:21:07.693 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/2.Shrink 2024-09-18T13:21:07.693 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:21:20.134 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/2.Shrink (12442 ms) 2024-09-18T13:21:20.134 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOne 2024-09-18T13:21:20.135 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:21:32.627 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/2.ShrinkToOne (12492 ms) 2024-09-18T13:21:32.627 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot 2024-09-18T13:21:32.627 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:21:46.647 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot (14020 ms) 2024-09-18T13:21:46.647 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/2.MinOverlap 2024-09-18T13:21:46.647 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:21:58.733 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/2.MinOverlap (12086 ms) 2024-09-18T13:21:58.733 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/2.ZeroOverlap 2024-09-18T13:21:58.733 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:22:10.381 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/2.ZeroOverlap (11649 ms) 2024-09-18T13:22:10.890 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/2 (92337 ms total) 2024-09-18T13:22:10.890 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:22:10.890 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:22:10.890 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 7 tests from 1 test suite ran. (92940 ms total) 2024-09-18T13:22:10.890 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 7 tests. 2024-09-18T13:22:10.999 INFO:tasks.workunit.client.0.smithi178.stdout:seed 44568 2024-09-18T13:22:10.999 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = EncryptedFlattenTest/3.* 2024-09-18T13:22:10.999 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-18T13:22:10.999 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:22:10.999 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/3, where TypeParam = LUKS1UnderLUKS1 2024-09-18T13:22:11.081 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/3.Simple 2024-09-18T13:22:12.900 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:22:31.615 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/3.Simple (20533 ms) 2024-09-18T13:22:31.615 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/3.Grow 2024-09-18T13:22:31.616 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:22:47.606 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/3.Grow (15991 ms) 2024-09-18T13:22:47.606 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/3.Shrink 2024-09-18T13:22:47.606 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:23:03.484 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/3.Shrink (15878 ms) 2024-09-18T13:23:03.484 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOne 2024-09-18T13:23:03.484 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:23:19.127 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/3.ShrinkToOne (15643 ms) 2024-09-18T13:23:19.127 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot 2024-09-18T13:23:19.127 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:23:36.573 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot (17446 ms) 2024-09-18T13:23:36.574 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/3.MinOverlap 2024-09-18T13:23:36.574 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:23:52.662 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/3.MinOverlap (16088 ms) 2024-09-18T13:23:52.662 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/3.ZeroOverlap 2024-09-18T13:23:52.662 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:24:08.077 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/3.ZeroOverlap (15415 ms) 2024-09-18T13:24:08.946 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/3 (116995 ms total) 2024-09-18T13:24:08.946 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:24:08.946 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:24:08.946 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 7 tests from 1 test suite ran. (117947 ms total) 2024-09-18T13:24:08.946 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 7 tests. 2024-09-18T13:24:09.023 INFO:tasks.workunit.client.0.smithi178.stdout:seed 44648 2024-09-18T13:24:09.023 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = EncryptedFlattenTest/4.* 2024-09-18T13:24:09.023 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-18T13:24:09.023 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:24:09.023 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/4, where TypeParam = LUKS1UnderLUKS2 2024-09-18T13:24:09.143 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/4.Simple 2024-09-18T13:24:10.953 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:24:31.380 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/4.Simple (22236 ms) 2024-09-18T13:24:31.380 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/4.Grow 2024-09-18T13:24:31.380 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:24:49.509 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/4.Grow (18130 ms) 2024-09-18T13:24:49.510 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/4.Shrink 2024-09-18T13:24:49.510 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:25:07.630 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/4.Shrink (18120 ms) 2024-09-18T13:25:07.631 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOne 2024-09-18T13:25:07.631 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:25:25.150 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/4.ShrinkToOne (17521 ms) 2024-09-18T13:25:25.151 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot 2024-09-18T13:25:25.151 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:25:45.639 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot (20488 ms) 2024-09-18T13:25:45.639 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/4.MinOverlap 2024-09-18T13:25:45.639 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:26:03.294 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/4.MinOverlap (17655 ms) 2024-09-18T13:26:03.294 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/4.ZeroOverlap 2024-09-18T13:26:03.295 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:26:20.975 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/4.ZeroOverlap (17681 ms) 2024-09-18T13:26:21.956 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/4 (131831 ms total) 2024-09-18T13:26:21.956 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:26:21.956 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:26:21.956 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 7 tests from 1 test suite ran. (132933 ms total) 2024-09-18T13:26:21.956 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 7 tests. 2024-09-18T13:26:22.069 INFO:tasks.workunit.client.0.smithi178.stdout:seed 49420 2024-09-18T13:26:22.070 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = EncryptedFlattenTest/5.* 2024-09-18T13:26:22.070 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-18T13:26:22.070 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:26:22.070 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/5, where TypeParam = UnformattedLUKS2 2024-09-18T13:26:22.160 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/5.Simple 2024-09-18T13:26:23.959 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:26:42.666 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/5.Simple (20506 ms) 2024-09-18T13:26:42.667 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/5.Grow 2024-09-18T13:26:42.667 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:26:57.745 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/5.Grow (15079 ms) 2024-09-18T13:26:57.746 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/5.Shrink 2024-09-18T13:26:57.746 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:27:11.820 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/5.Shrink (14074 ms) 2024-09-18T13:27:11.820 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOne 2024-09-18T13:27:11.820 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:27:26.248 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/5.ShrinkToOne (14428 ms) 2024-09-18T13:27:26.248 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot 2024-09-18T13:27:26.249 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:27:41.706 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot (15458 ms) 2024-09-18T13:27:41.706 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/5.MinOverlap 2024-09-18T13:27:41.706 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:27:55.464 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/5.MinOverlap (13757 ms) 2024-09-18T13:27:55.464 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/5.ZeroOverlap 2024-09-18T13:27:55.464 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:28:09.286 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/5.ZeroOverlap (13823 ms) 2024-09-18T13:28:09.990 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/5 (107125 ms total) 2024-09-18T13:28:09.990 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:28:09.990 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:28:09.990 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 7 tests from 1 test suite ran. (107921 ms total) 2024-09-18T13:28:09.990 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 7 tests. 2024-09-18T13:28:10.110 INFO:tasks.workunit.client.0.smithi178.stdout:seed 55215 2024-09-18T13:28:10.111 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = EncryptedFlattenTest/6.* 2024-09-18T13:28:10.111 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-18T13:28:10.111 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:28:10.111 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/6, where TypeParam = LUKS2UnderLUKS2 2024-09-18T13:28:10.205 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/6.Simple 2024-09-18T13:28:11.997 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:28:35.259 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/6.Simple (25053 ms) 2024-09-18T13:28:35.259 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/6.Grow 2024-09-18T13:28:35.260 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:28:56.441 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/6.Grow (21182 ms) 2024-09-18T13:28:56.441 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/6.Shrink 2024-09-18T13:28:56.441 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:29:16.553 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/6.Shrink (20112 ms) 2024-09-18T13:29:16.553 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOne 2024-09-18T13:29:16.553 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:29:38.055 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/6.ShrinkToOne (21503 ms) 2024-09-18T13:29:38.056 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot 2024-09-18T13:29:38.056 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:29:59.708 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot (21652 ms) 2024-09-18T13:29:59.709 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/6.MinOverlap 2024-09-18T13:29:59.709 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:30:20.141 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/6.MinOverlap (20434 ms) 2024-09-18T13:30:20.141 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/6.ZeroOverlap 2024-09-18T13:30:20.142 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:30:42.026 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/6.ZeroOverlap (21884 ms) 2024-09-18T13:30:42.137 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/6 (151820 ms total) 2024-09-18T13:30:42.138 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:30:42.138 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:30:42.138 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 7 tests from 1 test suite ran. (152026 ms total) 2024-09-18T13:30:42.138 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 7 tests. 2024-09-18T13:30:42.255 INFO:tasks.workunit.client.0.smithi178.stdout:seed 65045 2024-09-18T13:30:42.256 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = EncryptedFlattenTest/7.* 2024-09-18T13:30:42.256 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-18T13:30:42.256 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:30:42.256 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/7, where TypeParam = LUKS2UnderLUKS1 2024-09-18T13:30:42.341 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/7.Simple 2024-09-18T13:30:43.960 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:31:08.412 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/7.Simple (26070 ms) 2024-09-18T13:31:08.413 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/7.Grow 2024-09-18T13:31:08.413 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:31:31.547 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/7.Grow (23135 ms) 2024-09-18T13:31:31.547 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/7.Shrink 2024-09-18T13:31:31.547 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:31:53.548 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/7.Shrink (22000 ms) 2024-09-18T13:31:53.548 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOne 2024-09-18T13:31:53.548 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:32:15.313 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/7.ShrinkToOne (21765 ms) 2024-09-18T13:32:15.314 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot 2024-09-18T13:32:15.314 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:32:38.620 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot (23307 ms) 2024-09-18T13:32:38.620 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/7.MinOverlap 2024-09-18T13:32:38.620 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:33:01.457 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/7.MinOverlap (22835 ms) 2024-09-18T13:33:01.457 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] EncryptedFlattenTest/7.ZeroOverlap 2024-09-18T13:33:01.457 INFO:tasks.workunit.client.0.smithi178.stdout:using new format! 2024-09-18T13:33:23.200 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] EncryptedFlattenTest/7.ZeroOverlap (21745 ms) 2024-09-18T13:33:24.013 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 7 tests from EncryptedFlattenTest/7 (160858 ms total) 2024-09-18T13:33:24.013 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:33:24.013 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:33:24.013 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 7 tests from 1 test suite ran. (161756 ms total) 2024-09-18T13:33:24.013 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 7 tests. 2024-09-18T13:33:24.120 INFO:tasks.workunit.client.0.smithi178.stdout:seed 70065 2024-09-18T13:33:24.120 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = TestImageWatcher.* 2024-09-18T13:33:24.120 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-18T13:33:24.121 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:33:24.121 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 17 tests from TestImageWatcher 2024-09-18T13:33:26.020 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifyHeaderUpdate 2024-09-18T13:33:28.278 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifyHeaderUpdate (2258 ms) 2024-09-18T13:33:28.278 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifyFlatten 2024-09-18T13:33:28.518 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifyFlatten (240 ms) 2024-09-18T13:33:28.519 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifyResize 2024-09-18T13:33:28.775 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifyResize (257 ms) 2024-09-18T13:33:28.775 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifyRebuildObjectMap 2024-09-18T13:33:29.029 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifyRebuildObjectMap (254 ms) 2024-09-18T13:33:29.029 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifyUpdateFeatures 2024-09-18T13:33:29.273 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifyUpdateFeatures (244 ms) 2024-09-18T13:33:29.273 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifySnapCreate 2024-09-18T13:33:29.523 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifySnapCreate (250 ms) 2024-09-18T13:33:29.523 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifySnapCreateError 2024-09-18T13:33:29.751 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifySnapCreateError (228 ms) 2024-09-18T13:33:29.751 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifySnapRename 2024-09-18T13:33:29.997 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifySnapRename (246 ms) 2024-09-18T13:33:29.998 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifySnapRenameError 2024-09-18T13:33:30.219 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifySnapRenameError (221 ms) 2024-09-18T13:33:30.219 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifySnapRemove 2024-09-18T13:33:30.465 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifySnapRemove (246 ms) 2024-09-18T13:33:30.465 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifySnapProtect 2024-09-18T13:33:30.709 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifySnapProtect (244 ms) 2024-09-18T13:33:30.709 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifySnapUnprotect 2024-09-18T13:33:30.953 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifySnapUnprotect (244 ms) 2024-09-18T13:33:30.953 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifyRename 2024-09-18T13:33:31.188 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifyRename (235 ms) 2024-09-18T13:33:31.189 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifyAsyncTimedOut 2024-09-18T13:33:31.412 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifyAsyncTimedOut (224 ms) 2024-09-18T13:33:31.412 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifyAsyncError 2024-09-18T13:33:31.653 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifyAsyncError (241 ms) 2024-09-18T13:33:31.653 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifyAsyncCompleteError 2024-09-18T13:33:31.889 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifyAsyncCompleteError (236 ms) 2024-09-18T13:33:31.889 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-09-18T13:33:32.129 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestImageWatcher.NotifyAsyncRequestTimedOut (240 ms) 2024-09-18T13:33:33.038 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 17 tests from TestImageWatcher (6109 ms total) 2024-09-18T13:33:33.038 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:33:33.038 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:33:33.038 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 17 tests from 1 test suite ran. (8918 ms total) 2024-09-18T13:33:33.038 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 17 tests. 2024-09-18T13:33:33.153 INFO:tasks.workunit.client.0.smithi178.stdout:seed 70131 2024-09-18T13:33:33.154 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = TestInternal.* 2024-09-18T13:33:33.154 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 34 tests from 1 test suite. 2024-09-18T13:33:33.154 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:33:33.154 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 34 tests from TestInternal 2024-09-18T13:33:35.045 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.OpenByID 2024-09-18T13:33:37.352 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.OpenByID (2307 ms) 2024-09-18T13:33:37.352 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.OpenSnapDNE 2024-09-18T13:33:37.588 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.OpenSnapDNE (236 ms) 2024-09-18T13:33:37.588 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.IsExclusiveLockOwner 2024-09-18T13:33:37.832 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.IsExclusiveLockOwner (244 ms) 2024-09-18T13:33:37.832 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.ResizeLocksImage 2024-09-18T13:33:38.125 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.ResizeLocksImage (293 ms) 2024-09-18T13:33:38.125 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.ResizeFailsToLockImage 2024-09-18T13:33:38.320 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.ResizeFailsToLockImage (195 ms) 2024-09-18T13:33:38.320 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.SnapCreateLocksImage 2024-09-18T13:33:40.180 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.SnapCreateLocksImage (1860 ms) 2024-09-18T13:33:40.180 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.SnapCreateFailsToLockImage 2024-09-18T13:33:40.376 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.SnapCreateFailsToLockImage (196 ms) 2024-09-18T13:33:40.377 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.SnapRollbackLocksImage 2024-09-18T13:33:42.220 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.SnapRollbackLocksImage (1844 ms) 2024-09-18T13:33:42.220 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.SnapRollbackFailsToLockImage 2024-09-18T13:33:44.112 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.SnapRollbackFailsToLockImage (1892 ms) 2024-09-18T13:33:44.112 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.SnapSetReleasesLock 2024-09-18T13:33:46.218 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.SnapSetReleasesLock (2106 ms) 2024-09-18T13:33:46.218 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.FlattenLocksImage 2024-09-18T13:33:49.180 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.FlattenLocksImage (2962 ms) 2024-09-18T13:33:49.181 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.FlattenFailsToLockImage 2024-09-18T13:33:52.217 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.FlattenFailsToLockImage (3037 ms) 2024-09-18T13:33:52.217 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-18T13:33:52.292 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/test_internal.cc:382: Skipped 2024-09-18T13:33:52.292 INFO:tasks.workunit.client.0.smithi178.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:33:52.292 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted (74 ms) 2024-09-18T13:33:52.292 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-18T13:33:52.371 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/test_internal.cc:416: Skipped 2024-09-18T13:33:52.371 INFO:tasks.workunit.client.0.smithi178.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:33:52.371 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch (80 ms) 2024-09-18T13:33:52.371 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.AioWriteRequestsLock 2024-09-18T13:33:52.674 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.AioWriteRequestsLock (303 ms) 2024-09-18T13:33:52.674 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.AioDiscardRequestsLock 2024-09-18T13:33:52.960 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.AioDiscardRequestsLock (286 ms) 2024-09-18T13:33:52.960 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.CancelAsyncResize 2024-09-18T13:33:53.492 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.CancelAsyncResize (532 ms) 2024-09-18T13:33:53.492 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.MultipleResize 2024-09-18T13:33:54.233 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.MultipleResize (741 ms) 2024-09-18T13:33:54.233 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.Metadata 2024-09-18T13:33:54.877 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.Metadata (643 ms) 2024-09-18T13:33:54.877 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.MetadataConfApply 2024-09-18T13:33:55.239 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.MetadataConfApply (363 ms) 2024-09-18T13:33:55.239 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.SnapshotCopyup 2024-09-18T13:33:55.313 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/test_internal.cc:662: Skipped 2024-09-18T13:33:55.313 INFO:tasks.workunit.client.0.smithi178.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:33:55.313 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup (73 ms) 2024-09-18T13:33:55.313 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.SnapshotCopyupZeros 2024-09-18T13:33:57.393 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.SnapshotCopyupZeros (2081 ms) 2024-09-18T13:33:57.393 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.SnapshotCopyupZerosMigration 2024-09-18T13:33:59.416 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.SnapshotCopyupZerosMigration (2023 ms) 2024-09-18T13:33:59.416 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.ResizeCopyup 2024-09-18T13:34:01.722 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.ResizeCopyup (2305 ms) 2024-09-18T13:34:01.722 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.DiscardCopyup 2024-09-18T13:34:01.799 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/test_internal.cc:1055: Skipped 2024-09-18T13:34:01.799 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:34:01.799 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestInternal.DiscardCopyup (78 ms) 2024-09-18T13:34:01.799 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.ImageOptions 2024-09-18T13:34:01.876 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.ImageOptions (77 ms) 2024-09-18T13:34:01.876 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.WriteFullCopyup 2024-09-18T13:34:07.303 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.WriteFullCopyup (5427 ms) 2024-09-18T13:34:07.303 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.DiffIterateCloneOverwrite 2024-09-18T13:34:09.386 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.DiffIterateCloneOverwrite (2083 ms) 2024-09-18T13:34:09.386 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.TestCoR 2024-09-18T13:34:09.461 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/test_internal.cc:1312: Skipped 2024-09-18T13:34:09.461 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to disabled copy-on-read 2024-09-18T13:34:09.461 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestInternal.TestCoR (74 ms) 2024-09-18T13:34:09.461 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.FlattenNoEmptyObjects 2024-09-18T13:34:12.391 INFO:tasks.workunit.client.0.smithi178.stdout:made parent image "image39": 4194304K (1024 * 4K) 2024-09-18T13:34:12.391 INFO:tasks.workunit.client.0.smithi178.stdout:generated random write map: 2024-09-18T13:34:12.391 INFO:tasks.workunit.client.0.smithi178.stdout: [6 , 27904 ] 2024-09-18T13:34:12.391 INFO:tasks.workunit.client.0.smithi178.stdout: [45 , 185098 ] 2024-09-18T13:34:12.391 INFO:tasks.workunit.client.0.smithi178.stdout: [46 , 190613 ] 2024-09-18T13:34:12.391 INFO:tasks.workunit.client.0.smithi178.stdout: [58 , 238809 ] 2024-09-18T13:34:12.391 INFO:tasks.workunit.client.0.smithi178.stdout: [67 , 275425 ] 2024-09-18T13:34:12.391 INFO:tasks.workunit.client.0.smithi178.stdout: [69 , 284694 ] 2024-09-18T13:34:12.391 INFO:tasks.workunit.client.0.smithi178.stdout: [70 , 288373 ] 2024-09-18T13:34:12.391 INFO:tasks.workunit.client.0.smithi178.stdout: [80 , 329600 ] 2024-09-18T13:34:12.392 INFO:tasks.workunit.client.0.smithi178.stdout: [98 , 402393 ] 2024-09-18T13:34:12.392 INFO:tasks.workunit.client.0.smithi178.stdout: [118 , 485304 ] 2024-09-18T13:34:12.392 INFO:tasks.workunit.client.0.smithi178.stdout: [122 , 502964 ] 2024-09-18T13:34:12.392 INFO:tasks.workunit.client.0.smithi178.stdout: [126 , 519591 ] 2024-09-18T13:34:12.392 INFO:tasks.workunit.client.0.smithi178.stdout: [141 , 580780 ] 2024-09-18T13:34:12.392 INFO:tasks.workunit.client.0.smithi178.stdout: [142 , 581703 ] 2024-09-18T13:34:12.392 INFO:tasks.workunit.client.0.smithi178.stdout: [143 , 588199 ] 2024-09-18T13:34:12.392 INFO:tasks.workunit.client.0.smithi178.stdout: [145 , 597147 ] 2024-09-18T13:34:12.392 INFO:tasks.workunit.client.0.smithi178.stdout: [150 , 617320 ] 2024-09-18T13:34:12.392 INFO:tasks.workunit.client.0.smithi178.stdout: [156 , 639907 ] 2024-09-18T13:34:12.392 INFO:tasks.workunit.client.0.smithi178.stdout: [164 , 674877 ] 2024-09-18T13:34:12.392 INFO:tasks.workunit.client.0.smithi178.stdout: [183 , 751463 ] 2024-09-18T13:34:12.392 INFO:tasks.workunit.client.0.smithi178.stdout: [197 , 808173 ] 2024-09-18T13:34:12.392 INFO:tasks.workunit.client.0.smithi178.stdout: [216 , 884742 ] 2024-09-18T13:34:12.393 INFO:tasks.workunit.client.0.smithi178.stdout: [230 , 944094 ] 2024-09-18T13:34:12.393 INFO:tasks.workunit.client.0.smithi178.stdout: [240 , 984967 ] 2024-09-18T13:34:12.393 INFO:tasks.workunit.client.0.smithi178.stdout: [254 , 1041538 ] 2024-09-18T13:34:12.393 INFO:tasks.workunit.client.0.smithi178.stdout: [259 , 1063787 ] 2024-09-18T13:34:12.393 INFO:tasks.workunit.client.0.smithi178.stdout: [260 , 1066499 ] 2024-09-18T13:34:12.393 INFO:tasks.workunit.client.0.smithi178.stdout: [265 , 1086303 ] 2024-09-18T13:34:12.393 INFO:tasks.workunit.client.0.smithi178.stdout: [275 , 1129793 ] 2024-09-18T13:34:12.393 INFO:tasks.workunit.client.0.smithi178.stdout: [297 , 1219737 ] 2024-09-18T13:34:12.393 INFO:tasks.workunit.client.0.smithi178.stdout: [310 , 1271772 ] 2024-09-18T13:34:12.393 INFO:tasks.workunit.client.0.smithi178.stdout: [315 , 1290945 ] 2024-09-18T13:34:12.393 INFO:tasks.workunit.client.0.smithi178.stdout: [329 , 1348175 ] 2024-09-18T13:34:12.393 INFO:tasks.workunit.client.0.smithi178.stdout: [335 , 1372484 ] 2024-09-18T13:34:12.393 INFO:tasks.workunit.client.0.smithi178.stdout: [337 , 1382425 ] 2024-09-18T13:34:12.394 INFO:tasks.workunit.client.0.smithi178.stdout: [356 , 1460593 ] 2024-09-18T13:34:12.394 INFO:tasks.workunit.client.0.smithi178.stdout: [359 , 1470773 ] 2024-09-18T13:34:12.394 INFO:tasks.workunit.client.0.smithi178.stdout: [361 , 1480682 ] 2024-09-18T13:34:12.394 INFO:tasks.workunit.client.0.smithi178.stdout: [368 , 1508529 ] 2024-09-18T13:34:12.394 INFO:tasks.workunit.client.0.smithi178.stdout: [370 , 1515848 ] 2024-09-18T13:34:12.394 INFO:tasks.workunit.client.0.smithi178.stdout: [382 , 1565669 ] 2024-09-18T13:34:12.394 INFO:tasks.workunit.client.0.smithi178.stdout: [407 , 1667841 ] 2024-09-18T13:34:12.394 INFO:tasks.workunit.client.0.smithi178.stdout: [417 , 1710057 ] 2024-09-18T13:34:12.394 INFO:tasks.workunit.client.0.smithi178.stdout: [424 , 1738346 ] 2024-09-18T13:34:12.394 INFO:tasks.workunit.client.0.smithi178.stdout: [433 , 1775412 ] 2024-09-18T13:34:12.394 INFO:tasks.workunit.client.0.smithi178.stdout: [453 , 1858081 ] 2024-09-18T13:34:12.394 INFO:tasks.workunit.client.0.smithi178.stdout: [458 , 1878140 ] 2024-09-18T13:34:12.394 INFO:tasks.workunit.client.0.smithi178.stdout: [470 , 1928076 ] 2024-09-18T13:34:12.394 INFO:tasks.workunit.client.0.smithi178.stdout: [486 , 1991585 ] 2024-09-18T13:34:12.395 INFO:tasks.workunit.client.0.smithi178.stdout: [518 , 2123208 ] 2024-09-18T13:34:12.395 INFO:tasks.workunit.client.0.smithi178.stdout: [521 , 2136875 ] 2024-09-18T13:34:12.395 INFO:tasks.workunit.client.0.smithi178.stdout: [523 , 2143167 ] 2024-09-18T13:34:12.395 INFO:tasks.workunit.client.0.smithi178.stdout: [535 , 2193631 ] 2024-09-18T13:34:12.395 INFO:tasks.workunit.client.0.smithi178.stdout: [557 , 2282218 ] 2024-09-18T13:34:12.395 INFO:tasks.workunit.client.0.smithi178.stdout: [573 , 2350178 ] 2024-09-18T13:34:12.395 INFO:tasks.workunit.client.0.smithi178.stdout: [579 , 2374258 ] 2024-09-18T13:34:12.395 INFO:tasks.workunit.client.0.smithi178.stdout: [580 , 2375825 ] 2024-09-18T13:34:12.395 INFO:tasks.workunit.client.0.smithi178.stdout: [586 , 2400750 ] 2024-09-18T13:34:12.395 INFO:tasks.workunit.client.0.smithi178.stdout: [592 , 2425053 ] 2024-09-18T13:34:12.395 INFO:tasks.workunit.client.0.smithi178.stdout: [618 , 2532574 ] 2024-09-18T13:34:12.395 INFO:tasks.workunit.client.0.smithi178.stdout: [621 , 2544394 ] 2024-09-18T13:34:12.395 INFO:tasks.workunit.client.0.smithi178.stdout: [622 , 2549287 ] 2024-09-18T13:34:12.395 INFO:tasks.workunit.client.0.smithi178.stdout: [631 , 2584849 ] 2024-09-18T13:34:12.396 INFO:tasks.workunit.client.0.smithi178.stdout: [632 , 2590403 ] 2024-09-18T13:34:12.396 INFO:tasks.workunit.client.0.smithi178.stdout: [669 , 2742160 ] 2024-09-18T13:34:12.396 INFO:tasks.workunit.client.0.smithi178.stdout: [670 , 2746941 ] 2024-09-18T13:34:12.396 INFO:tasks.workunit.client.0.smithi178.stdout: [680 , 2787278 ] 2024-09-18T13:34:12.396 INFO:tasks.workunit.client.0.smithi178.stdout: [687 , 2814779 ] 2024-09-18T13:34:12.396 INFO:tasks.workunit.client.0.smithi178.stdout: [697 , 2857946 ] 2024-09-18T13:34:12.396 INFO:tasks.workunit.client.0.smithi178.stdout: [718 , 2942289 ] 2024-09-18T13:34:12.396 INFO:tasks.workunit.client.0.smithi178.stdout: [723 , 2964234 ] 2024-09-18T13:34:12.396 INFO:tasks.workunit.client.0.smithi178.stdout: [752 , 3082121 ] 2024-09-18T13:34:12.397 INFO:tasks.workunit.client.0.smithi178.stdout: [775 , 3177510 ] 2024-09-18T13:34:12.397 INFO:tasks.workunit.client.0.smithi178.stdout: [776 , 3181246 ] 2024-09-18T13:34:12.397 INFO:tasks.workunit.client.0.smithi178.stdout: [777 , 3185864 ] 2024-09-18T13:34:12.397 INFO:tasks.workunit.client.0.smithi178.stdout: [781 , 3200261 ] 2024-09-18T13:34:12.397 INFO:tasks.workunit.client.0.smithi178.stdout: [784 , 3212405 ] 2024-09-18T13:34:12.397 INFO:tasks.workunit.client.0.smithi178.stdout: [789 , 3234819 ] 2024-09-18T13:34:12.397 INFO:tasks.workunit.client.0.smithi178.stdout: [826 , 3385003 ] 2024-09-18T13:34:12.397 INFO:tasks.workunit.client.0.smithi178.stdout: [827 , 3389075 ] 2024-09-18T13:34:12.397 INFO:tasks.workunit.client.0.smithi178.stdout: [840 , 3441475 ] 2024-09-18T13:34:12.397 INFO:tasks.workunit.client.0.smithi178.stdout: [852 , 3491802 ] 2024-09-18T13:34:12.397 INFO:tasks.workunit.client.0.smithi178.stdout: [875 , 3585134 ] 2024-09-18T13:34:12.397 INFO:tasks.workunit.client.0.smithi178.stdout: [877 , 3593193 ] 2024-09-18T13:34:12.397 INFO:tasks.workunit.client.0.smithi178.stdout: [882 , 3614731 ] 2024-09-18T13:34:12.398 INFO:tasks.workunit.client.0.smithi178.stdout: [908 , 3722107 ] 2024-09-18T13:34:12.398 INFO:tasks.workunit.client.0.smithi178.stdout: [915 , 3750389 ] 2024-09-18T13:34:12.398 INFO:tasks.workunit.client.0.smithi178.stdout: [940 , 3852496 ] 2024-09-18T13:34:12.398 INFO:tasks.workunit.client.0.smithi178.stdout: [943 , 3863503 ] 2024-09-18T13:34:12.398 INFO:tasks.workunit.client.0.smithi178.stdout: [949 , 3890578 ] 2024-09-18T13:34:12.398 INFO:tasks.workunit.client.0.smithi178.stdout: [950 , 3892621 ] 2024-09-18T13:34:12.398 INFO:tasks.workunit.client.0.smithi178.stdout: [956 , 3918928 ] 2024-09-18T13:34:12.399 INFO:tasks.workunit.client.0.smithi178.stdout: [963 , 3945309 ] 2024-09-18T13:34:12.399 INFO:tasks.workunit.client.0.smithi178.stdout: [964 , 3949703 ] 2024-09-18T13:34:12.399 INFO:tasks.workunit.client.0.smithi178.stdout: [965 , 3954810 ] 2024-09-18T13:34:12.399 INFO:tasks.workunit.client.0.smithi178.stdout: [966 , 3958560 ] 2024-09-18T13:34:12.399 INFO:tasks.workunit.client.0.smithi178.stdout: [968 , 3967788 ] 2024-09-18T13:34:12.399 INFO:tasks.workunit.client.0.smithi178.stdout: [977 , 4004828 ] 2024-09-18T13:34:12.399 INFO:tasks.workunit.client.0.smithi178.stdout:write data based on random map 2024-09-18T13:34:12.399 INFO:tasks.workunit.client.0.smithi178.stdout: write object-6 2024-09-18T13:34:12.399 INFO:tasks.workunit.client.0.smithi178.stdout: write object-45 2024-09-18T13:34:12.399 INFO:tasks.workunit.client.0.smithi178.stdout: write object-46 2024-09-18T13:34:12.399 INFO:tasks.workunit.client.0.smithi178.stdout: write object-58 2024-09-18T13:34:12.399 INFO:tasks.workunit.client.0.smithi178.stdout: write object-67 2024-09-18T13:34:12.399 INFO:tasks.workunit.client.0.smithi178.stdout: write object-69 2024-09-18T13:34:12.399 INFO:tasks.workunit.client.0.smithi178.stdout: write object-70 2024-09-18T13:34:12.399 INFO:tasks.workunit.client.0.smithi178.stdout: write object-80 2024-09-18T13:34:12.400 INFO:tasks.workunit.client.0.smithi178.stdout: write object-98 2024-09-18T13:34:12.400 INFO:tasks.workunit.client.0.smithi178.stdout: write object-118 2024-09-18T13:34:12.400 INFO:tasks.workunit.client.0.smithi178.stdout: write object-122 2024-09-18T13:34:12.400 INFO:tasks.workunit.client.0.smithi178.stdout: write object-126 2024-09-18T13:34:12.400 INFO:tasks.workunit.client.0.smithi178.stdout: write object-141 2024-09-18T13:34:12.400 INFO:tasks.workunit.client.0.smithi178.stdout: write object-142 2024-09-18T13:34:12.400 INFO:tasks.workunit.client.0.smithi178.stdout: write object-143 2024-09-18T13:34:12.400 INFO:tasks.workunit.client.0.smithi178.stdout: write object-145 2024-09-18T13:34:12.400 INFO:tasks.workunit.client.0.smithi178.stdout: write object-150 2024-09-18T13:34:12.400 INFO:tasks.workunit.client.0.smithi178.stdout: write object-156 2024-09-18T13:34:12.400 INFO:tasks.workunit.client.0.smithi178.stdout: write object-164 2024-09-18T13:34:12.400 INFO:tasks.workunit.client.0.smithi178.stdout: write object-183 2024-09-18T13:34:12.400 INFO:tasks.workunit.client.0.smithi178.stdout: write object-197 2024-09-18T13:34:12.401 INFO:tasks.workunit.client.0.smithi178.stdout: write object-216 2024-09-18T13:34:12.401 INFO:tasks.workunit.client.0.smithi178.stdout: write object-230 2024-09-18T13:34:12.401 INFO:tasks.workunit.client.0.smithi178.stdout: write object-240 2024-09-18T13:34:12.401 INFO:tasks.workunit.client.0.smithi178.stdout: write object-254 2024-09-18T13:34:12.401 INFO:tasks.workunit.client.0.smithi178.stdout: write object-259 2024-09-18T13:34:12.401 INFO:tasks.workunit.client.0.smithi178.stdout: write object-260 2024-09-18T13:34:12.401 INFO:tasks.workunit.client.0.smithi178.stdout: write object-265 2024-09-18T13:34:12.401 INFO:tasks.workunit.client.0.smithi178.stdout: write object-275 2024-09-18T13:34:12.401 INFO:tasks.workunit.client.0.smithi178.stdout: write object-297 2024-09-18T13:34:12.401 INFO:tasks.workunit.client.0.smithi178.stdout: write object-310 2024-09-18T13:34:12.401 INFO:tasks.workunit.client.0.smithi178.stdout: write object-315 2024-09-18T13:34:12.401 INFO:tasks.workunit.client.0.smithi178.stdout: write object-329 2024-09-18T13:34:12.401 INFO:tasks.workunit.client.0.smithi178.stdout: write object-335 2024-09-18T13:34:12.401 INFO:tasks.workunit.client.0.smithi178.stdout: write object-337 2024-09-18T13:34:12.401 INFO:tasks.workunit.client.0.smithi178.stdout: write object-356 2024-09-18T13:34:12.402 INFO:tasks.workunit.client.0.smithi178.stdout: write object-359 2024-09-18T13:34:12.402 INFO:tasks.workunit.client.0.smithi178.stdout: write object-361 2024-09-18T13:34:12.402 INFO:tasks.workunit.client.0.smithi178.stdout: write object-368 2024-09-18T13:34:12.402 INFO:tasks.workunit.client.0.smithi178.stdout: write object-370 2024-09-18T13:34:12.402 INFO:tasks.workunit.client.0.smithi178.stdout: write object-382 2024-09-18T13:34:12.402 INFO:tasks.workunit.client.0.smithi178.stdout: write object-407 2024-09-18T13:34:12.402 INFO:tasks.workunit.client.0.smithi178.stdout: write object-417 2024-09-18T13:34:12.402 INFO:tasks.workunit.client.0.smithi178.stdout: write object-424 2024-09-18T13:34:12.402 INFO:tasks.workunit.client.0.smithi178.stdout: write object-433 2024-09-18T13:34:12.402 INFO:tasks.workunit.client.0.smithi178.stdout: write object-453 2024-09-18T13:34:12.402 INFO:tasks.workunit.client.0.smithi178.stdout: write object-458 2024-09-18T13:34:12.402 INFO:tasks.workunit.client.0.smithi178.stdout: write object-470 2024-09-18T13:34:12.402 INFO:tasks.workunit.client.0.smithi178.stdout: write object-486 2024-09-18T13:34:12.402 INFO:tasks.workunit.client.0.smithi178.stdout: write object-518 2024-09-18T13:34:12.403 INFO:tasks.workunit.client.0.smithi178.stdout: write object-521 2024-09-18T13:34:12.403 INFO:tasks.workunit.client.0.smithi178.stdout: write object-523 2024-09-18T13:34:12.403 INFO:tasks.workunit.client.0.smithi178.stdout: write object-535 2024-09-18T13:34:12.403 INFO:tasks.workunit.client.0.smithi178.stdout: write object-557 2024-09-18T13:34:12.403 INFO:tasks.workunit.client.0.smithi178.stdout: write object-573 2024-09-18T13:34:12.403 INFO:tasks.workunit.client.0.smithi178.stdout: write object-579 2024-09-18T13:34:12.403 INFO:tasks.workunit.client.0.smithi178.stdout: write object-580 2024-09-18T13:34:12.403 INFO:tasks.workunit.client.0.smithi178.stdout: write object-586 2024-09-18T13:34:12.403 INFO:tasks.workunit.client.0.smithi178.stdout: write object-592 2024-09-18T13:34:12.403 INFO:tasks.workunit.client.0.smithi178.stdout: write object-618 2024-09-18T13:34:12.403 INFO:tasks.workunit.client.0.smithi178.stdout: write object-621 2024-09-18T13:34:12.403 INFO:tasks.workunit.client.0.smithi178.stdout: write object-622 2024-09-18T13:34:12.403 INFO:tasks.workunit.client.0.smithi178.stdout: write object-631 2024-09-18T13:34:12.404 INFO:tasks.workunit.client.0.smithi178.stdout: write object-632 2024-09-18T13:34:12.404 INFO:tasks.workunit.client.0.smithi178.stdout: write object-669 2024-09-18T13:34:12.404 INFO:tasks.workunit.client.0.smithi178.stdout: write object-670 2024-09-18T13:34:12.404 INFO:tasks.workunit.client.0.smithi178.stdout: write object-680 2024-09-18T13:34:12.404 INFO:tasks.workunit.client.0.smithi178.stdout: write object-687 2024-09-18T13:34:12.404 INFO:tasks.workunit.client.0.smithi178.stdout: write object-697 2024-09-18T13:34:12.404 INFO:tasks.workunit.client.0.smithi178.stdout: write object-718 2024-09-18T13:34:12.404 INFO:tasks.workunit.client.0.smithi178.stdout: write object-723 2024-09-18T13:34:12.404 INFO:tasks.workunit.client.0.smithi178.stdout: write object-752 2024-09-18T13:34:12.404 INFO:tasks.workunit.client.0.smithi178.stdout: write object-775 2024-09-18T13:34:12.404 INFO:tasks.workunit.client.0.smithi178.stdout: write object-776 2024-09-18T13:34:12.404 INFO:tasks.workunit.client.0.smithi178.stdout: write object-777 2024-09-18T13:34:12.404 INFO:tasks.workunit.client.0.smithi178.stdout: write object-781 2024-09-18T13:34:12.405 INFO:tasks.workunit.client.0.smithi178.stdout: write object-784 2024-09-18T13:34:12.405 INFO:tasks.workunit.client.0.smithi178.stdout: write object-789 2024-09-18T13:34:12.405 INFO:tasks.workunit.client.0.smithi178.stdout: write object-826 2024-09-18T13:34:12.405 INFO:tasks.workunit.client.0.smithi178.stdout: write object-827 2024-09-18T13:34:12.405 INFO:tasks.workunit.client.0.smithi178.stdout: write object-840 2024-09-18T13:34:12.405 INFO:tasks.workunit.client.0.smithi178.stdout: write object-852 2024-09-18T13:34:12.405 INFO:tasks.workunit.client.0.smithi178.stdout: write object-875 2024-09-18T13:34:12.405 INFO:tasks.workunit.client.0.smithi178.stdout: write object-877 2024-09-18T13:34:12.405 INFO:tasks.workunit.client.0.smithi178.stdout: write object-882 2024-09-18T13:34:12.405 INFO:tasks.workunit.client.0.smithi178.stdout: write object-908 2024-09-18T13:34:16.270 INFO:tasks.workunit.client.0.smithi178.stdout: write object-915 2024-09-18T13:34:16.270 INFO:tasks.workunit.client.0.smithi178.stdout: write object-940 2024-09-18T13:34:16.270 INFO:tasks.workunit.client.0.smithi178.stdout: write object-943 2024-09-18T13:34:16.270 INFO:tasks.workunit.client.0.smithi178.stdout: write object-949 2024-09-18T13:34:16.270 INFO:tasks.workunit.client.0.smithi178.stdout: write object-950 2024-09-18T13:34:16.270 INFO:tasks.workunit.client.0.smithi178.stdout: write object-956 2024-09-18T13:34:16.270 INFO:tasks.workunit.client.0.smithi178.stdout: write object-963 2024-09-18T13:34:16.270 INFO:tasks.workunit.client.0.smithi178.stdout: write object-964 2024-09-18T13:34:16.270 INFO:tasks.workunit.client.0.smithi178.stdout: write object-965 2024-09-18T13:34:16.270 INFO:tasks.workunit.client.0.smithi178.stdout: write object-966 2024-09-18T13:34:16.271 INFO:tasks.workunit.client.0.smithi178.stdout: write object-968 2024-09-18T13:34:16.271 INFO:tasks.workunit.client.0.smithi178.stdout: write object-977 2024-09-18T13:34:16.271 INFO:tasks.workunit.client.0.smithi178.stdout:verify written data by reading 2024-09-18T13:34:16.271 INFO:tasks.workunit.client.0.smithi178.stdout: read object-6 2024-09-18T13:34:16.271 INFO:tasks.workunit.client.0.smithi178.stdout:made snapshot "image39@parent_snap" and protect it 2024-09-18T13:34:16.271 INFO:tasks.workunit.client.0.smithi178.stdout:made and opened clone "image40" 2024-09-18T13:34:16.271 INFO:tasks.workunit.client.0.smithi178.stdout:flattening clone: "image40" 2024-09-18T13:34:16.271 INFO:tasks.workunit.client.0.smithi178.stdout:check whether child image has the same set of objects as parent 2024-09-18T13:34:16.271 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.FlattenNoEmptyObjects (6809 ms) 2024-09-18T13:34:16.271 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.PoolMetadataConfApply 2024-09-18T13:34:17.001 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.PoolMetadataConfApply (732 ms) 2024-09-18T13:34:17.001 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.Sparsify 2024-09-18T13:34:17.247 INFO:tasks.workunit.client.0.smithi178.stdout:sparsify_supported=1 2024-09-18T13:34:17.248 INFO:tasks.workunit.client.0.smithi178.stdout:sparse_read_supported=1 2024-09-18T13:34:17.688 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.Sparsify (687 ms) 2024-09-18T13:34:17.688 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.SparsifyClone 2024-09-18T13:34:17.872 INFO:tasks.workunit.client.0.smithi178.stdout:sparsify_supported=1 2024-09-18T13:34:20.696 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.SparsifyClone (3007 ms) 2024-09-18T13:34:20.696 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestInternal.MissingDataPool 2024-09-18T13:34:22.748 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestInternal.MissingDataPool (2052 ms) 2024-09-18T13:34:23.589 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 34 tests from TestInternal (47702 ms total) 2024-09-18T13:34:23.589 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:34:23.589 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:34:23.589 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 34 tests from 1 test suite ran. (50436 ms total) 2024-09-18T13:34:23.589 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 29 tests. 2024-09-18T13:34:23.589 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] 5 tests, listed below: 2024-09-18T13:34:23.589 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-18T13:34:23.590 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-18T13:34:23.590 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup 2024-09-18T13:34:23.590 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestInternal.DiscardCopyup 2024-09-18T13:34:23.590 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestInternal.TestCoR 2024-09-18T13:34:23.668 INFO:tasks.workunit.client.0.smithi178.stdout:seed 70184 2024-09-18T13:34:23.668 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = TestMirroring.* 2024-09-18T13:34:23.669 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 51 tests from 1 test suite. 2024-09-18T13:34:23.669 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:34:23.669 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 51 tests from TestMirroring 2024-09-18T13:34:25.006 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage 2024-09-18T13:34:28.243 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage (3237 ms) 2024-09-18T13:34:28.244 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool 2024-09-18T13:34:29.608 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool (1365 ms) 2024-09-18T13:34:29.609 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled 2024-09-18T13:34:30.616 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled (1008 ms) 2024-09-18T13:34:30.616 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage 2024-09-18T13:34:31.954 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage (1338 ms) 2024-09-18T13:34:31.954 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap 2024-09-18T13:34:33.178 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap (1224 ms) 2024-09-18T13:34:33.178 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModePool 2024-09-18T13:34:34.457 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModePool (1279 ms) 2024-09-18T13:34:34.458 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled 2024-09-18T13:34:35.880 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled (1422 ms) 2024-09-18T13:34:35.880 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.DisableImageMirrorWithPeer 2024-09-18T13:34:35.880 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/test_mirroring.cc:482: Skipped 2024-09-18T13:34:35.880 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:34:35.880 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer (0 ms) 2024-09-18T13:34:35.880 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.DisableJournalingWithPeer 2024-09-18T13:34:35.880 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/test_mirroring.cc:520: Skipped 2024-09-18T13:34:35.881 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:34:35.881 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer (0 ms) 2024-09-18T13:34:35.881 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling 2024-09-18T13:34:36.775 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling (896 ms) 2024-09-18T13:34:36.775 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling 2024-09-18T13:34:37.754 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling (979 ms) 2024-09-18T13:34:37.754 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling 2024-09-18T13:34:40.476 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling (2722 ms) 2024-09-18T13:34:40.476 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock 2024-09-18T13:34:42.395 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock (1918 ms) 2024-09-18T13:34:42.395 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeDisabled 2024-09-18T13:34:43.503 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeDisabled (1109 ms) 2024-09-18T13:34:43.503 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage 2024-09-18T13:34:44.650 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage (1147 ms) 2024-09-18T13:34:44.650 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool 2024-09-18T13:34:45.965 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool (1315 ms) 2024-09-18T13:34:45.965 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling 2024-09-18T13:34:46.990 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling (1025 ms) 2024-09-18T13:34:46.990 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling 2024-09-18T13:34:47.992 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling (1002 ms) 2024-09-18T13:34:47.992 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeDisabled 2024-09-18T13:34:49.200 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeDisabled (1208 ms) 2024-09-18T13:34:49.200 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage 2024-09-18T13:34:50.522 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage (1322 ms) 2024-09-18T13:34:50.522 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled 2024-09-18T13:34:52.655 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled (2132 ms) 2024-09-18T13:34:52.655 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModePool 2024-09-18T13:34:54.091 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModePool (1437 ms) 2024-09-18T13:34:54.091 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModePool 2024-09-18T13:34:55.414 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModePool (1322 ms) 2024-09-18T13:34:55.414 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModeImage 2024-09-18T13:34:56.672 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModeImage (1259 ms) 2024-09-18T13:34:56.673 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode 2024-09-18T13:34:58.671 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode (1999 ms) 2024-09-18T13:34:58.671 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode 2024-09-18T13:35:00.606 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode (1935 ms) 2024-09-18T13:35:00.606 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode 2024-09-18T13:35:02.342 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode (1735 ms) 2024-09-18T13:35:02.343 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode 2024-09-18T13:35:04.154 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode (1813 ms) 2024-09-18T13:35:04.154 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode 2024-09-18T13:35:06.090 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode (1936 ms) 2024-09-18T13:35:06.091 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode 2024-09-18T13:35:08.263 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode (2173 ms) 2024-09-18T13:35:08.263 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageEnabled 2024-09-18T13:35:09.299 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageEnabled (1036 ms) 2024-09-18T13:35:09.299 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDisabled 2024-09-18T13:35:10.266 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDisabled (967 ms) 2024-09-18T13:35:10.266 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.RemoveImage_With_ImageWithoutJournal 2024-09-18T13:35:11.063 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.RemoveImage_With_ImageWithoutJournal (797 ms) 2024-09-18T13:35:11.064 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDemoted 2024-09-18T13:35:12.714 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDemoted (1651 ms) 2024-09-18T13:35:12.714 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.TrashMoveRestore_PoolMode 2024-09-18T13:35:14.348 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.TrashMoveRestore_PoolMode (1634 ms) 2024-09-18T13:35:14.348 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled 2024-09-18T13:35:15.694 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled (1346 ms) 2024-09-18T13:35:15.695 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled 2024-09-18T13:35:17.137 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled (1443 ms) 2024-09-18T13:35:17.137 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.MirrorStatusList 2024-09-18T13:35:18.045 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.MirrorStatusList (908 ms) 2024-09-18T13:35:18.045 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.RemoveBootstrapped 2024-09-18T13:35:19.268 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.RemoveBootstrapped (1223 ms) 2024-09-18T13:35:19.268 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.AioPromoteDemote 2024-09-18T13:35:25.434 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.AioPromoteDemote (6166 ms) 2024-09-18T13:35:25.434 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.AioGetInfo 2024-09-18T13:35:29.873 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.AioGetInfo (4439 ms) 2024-09-18T13:35:29.874 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.AioGetStatus 2024-09-18T13:35:32.616 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.AioGetStatus (2743 ms) 2024-09-18T13:35:32.617 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.SiteName 2024-09-18T13:35:32.623 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.SiteName (7 ms) 2024-09-18T13:35:32.623 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.Bootstrap 2024-09-18T13:35:44.397 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.Bootstrap (11773 ms) 2024-09-18T13:35:44.397 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.PeerDirection 2024-09-18T13:35:44.467 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.PeerDirection (71 ms) 2024-09-18T13:35:44.467 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.Snapshot 2024-09-18T13:36:00.961 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.Snapshot (16494 ms) 2024-09-18T13:36:00.962 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.SnapshotRemoveOnDisable 2024-09-18T13:36:06.002 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.SnapshotRemoveOnDisable (5041 ms) 2024-09-18T13:36:06.002 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.SnapshotUnlinkPeer 2024-09-18T13:36:17.860 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.SnapshotUnlinkPeer (11857 ms) 2024-09-18T13:36:17.860 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.SnapshotImageState 2024-09-18T13:36:24.496 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.SnapshotImageState (6636 ms) 2024-09-18T13:36:24.496 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.SnapshotPromoteDemote 2024-09-18T13:36:34.565 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.SnapshotPromoteDemote (10070 ms) 2024-09-18T13:36:34.565 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroring.AioSnapshotCreate 2024-09-18T13:37:06.649 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroring.AioSnapshotCreate (32084 ms) 2024-09-18T13:37:07.599 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 51 tests from TestMirroring (161643 ms total) 2024-09-18T13:37:07.600 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:37:07.600 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:37:07.600 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 51 tests from 1 test suite ran. (163931 ms total) 2024-09-18T13:37:07.600 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 49 tests. 2024-09-18T13:37:07.600 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-18T13:37:07.600 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer 2024-09-18T13:37:07.600 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer 2024-09-18T13:37:07.714 INFO:tasks.workunit.client.0.smithi178.stdout:seed 70692 2024-09-18T13:37:07.714 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = TestGroup.* 2024-09-18T13:37:07.714 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-18T13:37:07.714 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:37:07.714 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 13 tests from TestGroup 2024-09-18T13:37:09.025 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestGroup.group_create 2024-09-18T13:37:11.241 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestGroup.group_create (2216 ms) 2024-09-18T13:37:11.241 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestGroup.group_createPP 2024-09-18T13:37:11.427 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestGroup.group_createPP (185 ms) 2024-09-18T13:37:11.427 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestGroup.group_get_id 2024-09-18T13:37:11.579 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestGroup.group_get_id (152 ms) 2024-09-18T13:37:11.579 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestGroup.group_get_idPP 2024-09-18T13:37:11.725 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestGroup.group_get_idPP (146 ms) 2024-09-18T13:37:11.725 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestGroup.add_image 2024-09-18T13:37:12.208 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestGroup.add_image (483 ms) 2024-09-18T13:37:12.208 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestGroup.add_imagePP 2024-09-18T13:37:12.649 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestGroup.add_imagePP (441 ms) 2024-09-18T13:37:12.649 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestGroup.add_snapshot 2024-09-18T13:37:19.267 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestGroup.add_snapshot (6617 ms) 2024-09-18T13:37:19.267 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestGroup.add_snapshotPP 2024-09-18T13:37:25.331 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestGroup.add_snapshotPP (6065 ms) 2024-09-18T13:37:25.332 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestGroup.snap_get_info 2024-09-18T13:37:30.096 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestGroup.snap_get_info (4764 ms) 2024-09-18T13:37:30.096 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestGroup.snap_get_infoPP 2024-09-18T13:37:35.114 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestGroup.snap_get_infoPP (5019 ms) 2024-09-18T13:37:35.114 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestGroup.snap_list2 2024-09-18T13:37:46.154 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestGroup.snap_list2 (11039 ms) 2024-09-18T13:37:46.154 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestGroup.snap_list2PP 2024-09-18T13:37:57.199 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestGroup.snap_list2PP (11046 ms) 2024-09-18T13:37:57.199 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestGroup.snap_list_internal 2024-09-18T13:37:59.054 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestGroup.snap_list_internal (1855 ms) 2024-09-18T13:38:00.043 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 13 tests from TestGroup (50029 ms total) 2024-09-18T13:38:00.043 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:38:00.043 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:38:00.043 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 13 tests from 1 test suite ran. (52329 ms total) 2024-09-18T13:38:00.043 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 13 tests. 2024-09-18T13:38:00.144 INFO:tasks.workunit.client.0.smithi178.stdout:seed 70755 2024-09-18T13:38:00.144 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = TestMirroringWatcher.* 2024-09-18T13:38:00.144 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-18T13:38:00.144 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:38:00.144 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 2 tests from TestMirroringWatcher 2024-09-18T13:38:02.049 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroringWatcher.ModeUpdated 2024-09-18T13:38:04.302 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroringWatcher.ModeUpdated (2253 ms) 2024-09-18T13:38:04.302 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestMirroringWatcher.ImageStatusUpdated 2024-09-18T13:38:04.507 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestMirroringWatcher.ImageStatusUpdated (205 ms) 2024-09-18T13:38:05.062 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 2 tests from TestMirroringWatcher (2458 ms total) 2024-09-18T13:38:05.062 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:38:05.062 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:38:05.062 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 2 tests from 1 test suite ran. (4918 ms total) 2024-09-18T13:38:05.062 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 2 tests. 2024-09-18T13:38:05.154 INFO:tasks.workunit.client.0.smithi178.stdout:seed 70807 2024-09-18T13:38:05.154 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = TestObjectMap.* 2024-09-18T13:38:05.154 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-18T13:38:05.154 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:38:05.154 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 4 tests from TestObjectMap 2024-09-18T13:38:07.068 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-09-18T13:38:09.397 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestObjectMap.RefreshInvalidatesWhenCorrupt (2329 ms) 2024-09-18T13:38:09.397 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-09-18T13:38:09.686 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestObjectMap.RefreshInvalidatesWhenTooSmall (289 ms) 2024-09-18T13:38:09.686 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestObjectMap.InvalidateFlagOnDisk 2024-09-18T13:38:10.071 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestObjectMap.InvalidateFlagOnDisk (385 ms) 2024-09-18T13:38:10.071 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-09-18T13:38:10.388 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall (317 ms) 2024-09-18T13:38:11.083 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 4 tests from TestObjectMap (3320 ms total) 2024-09-18T13:38:11.084 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:38:11.084 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:38:11.084 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 4 tests from 1 test suite ran. (5929 ms total) 2024-09-18T13:38:11.084 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 4 tests. 2024-09-18T13:38:11.084 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:38:11.084 INFO:tasks.workunit.client.0.smithi178.stdout: YOU HAVE 1 DISABLED TEST 2024-09-18T13:38:11.084 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:38:11.196 INFO:tasks.workunit.client.0.smithi178.stdout:seed 70859 2024-09-18T13:38:11.196 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = TestOperations.* 2024-09-18T13:38:11.196 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 1 test from 1 test suite. 2024-09-18T13:38:11.196 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:38:11.197 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 1 test from TestOperations 2024-09-18T13:38:13.090 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestOperations.DisableJournalingCorrupt 2024-09-18T13:38:15.209 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/test_Operations.cc:18: Skipped 2024-09-18T13:38:15.209 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:15.209 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt (2119 ms) 2024-09-18T13:38:16.146 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 1 test from TestOperations (2119 ms total) 2024-09-18T13:38:16.146 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:38:16.147 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:38:16.147 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 1 test from 1 test suite ran. (4950 ms total) 2024-09-18T13:38:16.147 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 0 tests. 2024-09-18T13:38:16.147 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-18T13:38:16.147 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt 2024-09-18T13:38:16.224 INFO:tasks.workunit.client.0.smithi178.stdout:seed 70909 2024-09-18T13:38:16.226 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = TestTrash.* 2024-09-18T13:38:16.226 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-18T13:38:16.226 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:38:16.226 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 2 tests from TestTrash 2024-09-18T13:38:18.155 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestTrash.UserRemovingSource 2024-09-18T13:38:21.004 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestTrash.UserRemovingSource (2849 ms) 2024-09-18T13:38:21.005 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestTrash.RestoreMirroringSource 2024-09-18T13:38:21.490 INFO:tasks.workunit.client.0.smithi178.stdout:[ OK ] TestTrash.RestoreMirroringSource (486 ms) 2024-09-18T13:38:22.173 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 2 tests from TestTrash (3335 ms total) 2024-09-18T13:38:22.173 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:38:22.173 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:38:22.173 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 2 tests from 1 test suite ran. (5948 ms total) 2024-09-18T13:38:22.174 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 2 tests. 2024-09-18T13:38:22.266 INFO:tasks.workunit.client.0.smithi178.stdout:seed 70961 2024-09-18T13:38:22.266 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = TestJournalEntries.* 2024-09-18T13:38:22.266 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-18T13:38:22.266 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:38:22.266 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 4 tests from TestJournalEntries 2024-09-18T13:38:24.181 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalEntries.AioWrite 2024-09-18T13:38:26.304 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Entries.cc:118: Skipped 2024-09-18T13:38:26.305 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:26.305 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalEntries.AioWrite (2123 ms) 2024-09-18T13:38:26.305 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalEntries.AioDiscard 2024-09-18T13:38:26.380 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Entries.cc:163: Skipped 2024-09-18T13:38:26.380 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:26.380 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard (76 ms) 2024-09-18T13:38:26.380 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalEntries.AioDiscardWithPrune 2024-09-18T13:38:26.455 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Entries.cc:200: Skipped 2024-09-18T13:38:26.455 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:26.455 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune (75 ms) 2024-09-18T13:38:26.455 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalEntries.AioFlush 2024-09-18T13:38:26.529 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Entries.cc:263: Skipped 2024-09-18T13:38:26.529 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:26.529 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalEntries.AioFlush (74 ms) 2024-09-18T13:38:27.197 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 4 tests from TestJournalEntries (2348 ms total) 2024-09-18T13:38:27.197 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:38:27.197 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:38:27.197 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 4 tests from 1 test suite ran. (4932 ms total) 2024-09-18T13:38:27.197 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 0 tests. 2024-09-18T13:38:27.197 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-18T13:38:27.197 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalEntries.AioWrite 2024-09-18T13:38:27.197 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard 2024-09-18T13:38:27.197 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune 2024-09-18T13:38:27.197 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalEntries.AioFlush 2024-09-18T13:38:27.298 INFO:tasks.workunit.client.0.smithi178.stdout:seed 71010 2024-09-18T13:38:27.299 INFO:tasks.workunit.client.0.smithi178.stdout:Note: Google Test filter = TestJournalReplay.* 2024-09-18T13:38:27.299 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] Running 16 tests from 1 test suite. 2024-09-18T13:38:27.300 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment set-up. 2024-09-18T13:38:27.300 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 16 tests from TestJournalReplay 2024-09-18T13:38:29.044 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.AioDiscardEvent 2024-09-18T13:38:31.321 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:109: Skipped 2024-09-18T13:38:31.321 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:31.321 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent (2278 ms) 2024-09-18T13:38:31.321 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.AioWriteEvent 2024-09-18T13:38:31.397 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:200: Skipped 2024-09-18T13:38:31.397 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:31.397 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent (76 ms) 2024-09-18T13:38:31.397 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.AioFlushEvent 2024-09-18T13:38:31.469 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:261: Skipped 2024-09-18T13:38:31.469 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:31.469 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent (72 ms) 2024-09-18T13:38:31.469 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.SnapCreate 2024-09-18T13:38:31.540 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:307: Skipped 2024-09-18T13:38:31.540 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:31.540 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate (71 ms) 2024-09-18T13:38:31.540 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.SnapProtect 2024-09-18T13:38:31.613 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:348: Skipped 2024-09-18T13:38:31.613 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:31.613 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect (73 ms) 2024-09-18T13:38:31.613 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.SnapUnprotect 2024-09-18T13:38:31.684 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:394: Skipped 2024-09-18T13:38:31.684 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:31.684 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect (71 ms) 2024-09-18T13:38:31.684 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.SnapRename 2024-09-18T13:38:31.756 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:450: Skipped 2024-09-18T13:38:31.756 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:31.756 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.SnapRename (72 ms) 2024-09-18T13:38:31.756 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.SnapRollback 2024-09-18T13:38:31.829 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:500: Skipped 2024-09-18T13:38:31.829 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:31.829 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback (73 ms) 2024-09-18T13:38:31.829 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.SnapRemove 2024-09-18T13:38:31.902 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:541: Skipped 2024-09-18T13:38:31.902 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:31.902 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove (73 ms) 2024-09-18T13:38:31.902 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.Rename 2024-09-18T13:38:31.975 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:590: Skipped 2024-09-18T13:38:31.975 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:31.975 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.Rename (72 ms) 2024-09-18T13:38:31.975 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.Resize 2024-09-18T13:38:32.048 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:624: Skipped 2024-09-18T13:38:32.049 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:32.049 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.Resize (74 ms) 2024-09-18T13:38:32.049 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.Flatten 2024-09-18T13:38:32.122 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:657: Skipped 2024-09-18T13:38:32.122 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:32.122 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.Flatten (74 ms) 2024-09-18T13:38:32.123 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.UpdateFeatures 2024-09-18T13:38:32.197 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:704: Skipped 2024-09-18T13:38:32.197 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:32.197 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures (75 ms) 2024-09-18T13:38:32.198 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.MetadataSet 2024-09-18T13:38:32.273 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:741: Skipped 2024-09-18T13:38:32.273 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:32.273 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet (76 ms) 2024-09-18T13:38:32.273 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.MetadataRemove 2024-09-18T13:38:32.353 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:781: Skipped 2024-09-18T13:38:32.353 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:32.353 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove (80 ms) 2024-09-18T13:38:32.353 INFO:tasks.workunit.client.0.smithi178.stdout:[ RUN ] TestJournalReplay.ObjectPosition 2024-09-18T13:38:32.439 INFO:tasks.workunit.client.0.smithi178.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librbd/journal/test_Replay.cc:824: Skipped 2024-09-18T13:38:32.439 INFO:tasks.workunit.client.0.smithi178.stdout:Skipping due to unmet REQUIRE 2024-09-18T13:38:32.439 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition (86 ms) 2024-09-18T13:38:33.213 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] 16 tests from TestJournalReplay (3396 ms total) 2024-09-18T13:38:33.213 INFO:tasks.workunit.client.0.smithi178.stdout: 2024-09-18T13:38:33.214 INFO:tasks.workunit.client.0.smithi178.stdout:[----------] Global test environment tear-down 2024-09-18T13:38:33.214 INFO:tasks.workunit.client.0.smithi178.stdout:[==========] 16 tests from 1 test suite ran. (5914 ms total) 2024-09-18T13:38:33.214 INFO:tasks.workunit.client.0.smithi178.stdout:[ PASSED ] 0 tests. 2024-09-18T13:38:33.214 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-18T13:38:33.214 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent 2024-09-18T13:38:33.214 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent 2024-09-18T13:38:33.214 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent 2024-09-18T13:38:33.214 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate 2024-09-18T13:38:33.214 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect 2024-09-18T13:38:33.214 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect 2024-09-18T13:38:33.214 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.SnapRename 2024-09-18T13:38:33.214 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback 2024-09-18T13:38:33.214 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove 2024-09-18T13:38:33.215 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.Rename 2024-09-18T13:38:33.215 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.Resize 2024-09-18T13:38:33.215 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.Flatten 2024-09-18T13:38:33.215 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures 2024-09-18T13:38:33.215 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet 2024-09-18T13:38:33.215 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove 2024-09-18T13:38:33.215 INFO:tasks.workunit.client.0.smithi178.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition 2024-09-18T13:38:33.220 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-18T13:38:33.220 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-18T13:38:33.253 INFO:tasks.workunit:Stopping ['rbd/crimson/test_crimson_librbd.sh'] on client.0... 2024-09-18T13:38:33.253 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-18T13:38:33.697 DEBUG:teuthology.parallel:result is None 2024-09-18T13:38:33.697 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T13:38:33.725 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T13:38:33.725 DEBUG:teuthology.orchestra.run.smithi178:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-18T13:38:33.840 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T13:38:33.840 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-18T13:38:33.850 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T13:38:33.850 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T13:38:33.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:33.953+0000 7fec6ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:33.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:33.960+0000 7fec6ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:34.149 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T13:38:34.149 INFO:teuthology.orchestra.run.smithi178.stderr:dumped all 2024-09-18T13:38:34.162 INFO:teuthology.orchestra.run.smithi178.stdout:{"pg_ready":true,"pg_map":{"version":1847,"stamp":"2024-09-18T13:38:34.040521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":208536,"kb_used_data":7272,"kb_used_omap":0,"kb_used_meta":201216,"kb_avail":282906984,"statfs":{"total":289910292480,"available":289696751616,"internally_reserved":0,"allocated":7446528,"data_stored":4535653,"data_compressed":59988,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":206045184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.000821"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.225502+0000","last_change":"2024-09-18T12:58:07.294450+0000","last_active":"2024-09-18T13:38:31.225502+0000","last_peered":"2024-09-18T13:38:31.225502+0000","last_clean":"2024-09-18T13:38:31.225502+0000","last_became_active":"2024-09-18T12:58:05.359472+0000","last_became_peered":"2024-09-18T12:58:05.359472+0000","last_unstale":"2024-09-18T13:38:31.225502+0000","last_undegraded":"2024-09-18T13:38:31.225502+0000","last_fullsized":"2024-09-18T13:38:31.225502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.231997+0000","last_change":"2024-09-18T12:58:07.301180+0000","last_active":"2024-09-18T13:38:31.231997+0000","last_peered":"2024-09-18T13:38:31.231997+0000","last_clean":"2024-09-18T13:38:31.231997+0000","last_became_active":"2024-09-18T12:58:05.381352+0000","last_became_peered":"2024-09-18T12:58:05.381352+0000","last_unstale":"2024-09-18T13:38:31.231997+0000","last_undegraded":"2024-09-18T13:38:31.231997+0000","last_fullsized":"2024-09-18T13:38:31.231997+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.224340+0000","last_change":"2024-09-18T12:58:07.293981+0000","last_active":"2024-09-18T13:38:31.224340+0000","last_peered":"2024-09-18T13:38:31.224340+0000","last_clean":"2024-09-18T13:38:31.224340+0000","last_became_active":"2024-09-18T12:58:05.334716+0000","last_became_peered":"2024-09-18T12:58:05.334716+0000","last_unstale":"2024-09-18T13:38:31.224340+0000","last_undegraded":"2024-09-18T13:38:31.224340+0000","last_fullsized":"2024-09-18T13:38:31.224340+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.226945+0000","last_change":"2024-09-18T12:58:07.299969+0000","last_active":"2024-09-18T13:38:31.226945+0000","last_peered":"2024-09-18T13:38:31.226945+0000","last_clean":"2024-09-18T13:38:31.226945+0000","last_became_active":"2024-09-18T12:58:05.367264+0000","last_became_peered":"2024-09-18T12:58:05.367264+0000","last_unstale":"2024-09-18T13:38:31.226945+0000","last_undegraded":"2024-09-18T13:38:31.226945+0000","last_fullsized":"2024-09-18T13:38:31.226945+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"13'2","reported_seq":1886,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.236281+0000","last_change":"2024-09-18T12:58:07.296152+0000","last_active":"2024-09-18T13:38:31.236281+0000","last_peered":"2024-09-18T13:38:31.236281+0000","last_clean":"2024-09-18T13:38:31.236281+0000","last_became_active":"2024-09-18T12:58:05.351346+0000","last_became_peered":"2024-09-18T12:58:05.351346+0000","last_unstale":"2024-09-18T13:38:31.236281+0000","last_undegraded":"2024-09-18T13:38:31.236281+0000","last_fullsized":"2024-09-18T13:38:31.236281+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.239122+0000","last_change":"2024-09-18T12:58:07.296880+0000","last_active":"2024-09-18T13:38:31.239122+0000","last_peered":"2024-09-18T13:38:31.239122+0000","last_clean":"2024-09-18T13:38:31.239122+0000","last_became_active":"2024-09-18T12:58:05.380953+0000","last_became_peered":"2024-09-18T12:58:05.380953+0000","last_unstale":"2024-09-18T13:38:31.239122+0000","last_undegraded":"2024-09-18T13:38:31.239122+0000","last_fullsized":"2024-09-18T13:38:31.239122+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.232611+0000","last_change":"2024-09-18T12:58:07.296003+0000","last_active":"2024-09-18T13:38:31.232611+0000","last_peered":"2024-09-18T13:38:31.232611+0000","last_clean":"2024-09-18T13:38:31.232611+0000","last_became_active":"2024-09-18T12:58:05.356265+0000","last_became_peered":"2024-09-18T12:58:05.356265+0000","last_unstale":"2024-09-18T13:38:31.232611+0000","last_undegraded":"2024-09-18T13:38:31.232611+0000","last_fullsized":"2024-09-18T13:38:31.232611+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"11'1","reported_seq":1885,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.241186+0000","last_change":"2024-09-18T12:58:07.300851+0000","last_active":"2024-09-18T13:38:31.241186+0000","last_peered":"2024-09-18T13:38:31.241186+0000","last_clean":"2024-09-18T13:38:31.241186+0000","last_became_active":"2024-09-18T12:58:05.338947+0000","last_became_peered":"2024-09-18T12:58:05.338947+0000","last_unstale":"2024-09-18T13:38:31.241186+0000","last_undegraded":"2024-09-18T13:38:31.241186+0000","last_fullsized":"2024-09-18T13:38:31.241186+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":1953,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.223194+0000","last_change":"2024-09-18T12:58:04.328557+0000","last_active":"2024-09-18T13:38:31.223194+0000","last_peered":"2024-09-18T13:38:31.223194+0000","last_clean":"2024-09-18T13:38:31.223194+0000","last_became_active":"2024-09-18T12:58:04.317289+0000","last_became_peered":"2024-09-18T12:58:04.317289+0000","last_unstale":"2024-09-18T13:38:31.223194+0000","last_undegraded":"2024-09-18T13:38:31.223194+0000","last_fullsized":"2024-09-18T13:38:31.223194+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:03.253584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:03.253584+0000","last_clean_scrub_stamp":"2024-09-18T12:58:03.253584+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740791,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69476,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302364,"statfs":{"total":96636764160,"available":96565620736,"internally_reserved":0,"allocated":2445312,"data_stored":1118339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740791,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69544,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302296,"statfs":{"total":96636764160,"available":96565551104,"internally_reserved":0,"allocated":2514944,"data_stored":1708723,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359740789,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69516,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302324,"statfs":{"total":96636764160,"available":96565579776,"internally_reserved":0,"allocated":2486272,"data_stored":1708591,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T13:38:34.163 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T13:38:34.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:34.266+0000 7f9a77688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:34.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:34.274+0000 7f9a77688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:34.458 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T13:38:34.458 INFO:teuthology.orchestra.run.smithi178.stderr:dumped all 2024-09-18T13:38:34.471 INFO:teuthology.orchestra.run.smithi178.stdout:{"pg_ready":true,"pg_map":{"version":1847,"stamp":"2024-09-18T13:38:34.040521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":208536,"kb_used_data":7272,"kb_used_omap":0,"kb_used_meta":201216,"kb_avail":282906984,"statfs":{"total":289910292480,"available":289696751616,"internally_reserved":0,"allocated":7446528,"data_stored":4535653,"data_compressed":59988,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":206045184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.000821"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.225502+0000","last_change":"2024-09-18T12:58:07.294450+0000","last_active":"2024-09-18T13:38:31.225502+0000","last_peered":"2024-09-18T13:38:31.225502+0000","last_clean":"2024-09-18T13:38:31.225502+0000","last_became_active":"2024-09-18T12:58:05.359472+0000","last_became_peered":"2024-09-18T12:58:05.359472+0000","last_unstale":"2024-09-18T13:38:31.225502+0000","last_undegraded":"2024-09-18T13:38:31.225502+0000","last_fullsized":"2024-09-18T13:38:31.225502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.231997+0000","last_change":"2024-09-18T12:58:07.301180+0000","last_active":"2024-09-18T13:38:31.231997+0000","last_peered":"2024-09-18T13:38:31.231997+0000","last_clean":"2024-09-18T13:38:31.231997+0000","last_became_active":"2024-09-18T12:58:05.381352+0000","last_became_peered":"2024-09-18T12:58:05.381352+0000","last_unstale":"2024-09-18T13:38:31.231997+0000","last_undegraded":"2024-09-18T13:38:31.231997+0000","last_fullsized":"2024-09-18T13:38:31.231997+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.224340+0000","last_change":"2024-09-18T12:58:07.293981+0000","last_active":"2024-09-18T13:38:31.224340+0000","last_peered":"2024-09-18T13:38:31.224340+0000","last_clean":"2024-09-18T13:38:31.224340+0000","last_became_active":"2024-09-18T12:58:05.334716+0000","last_became_peered":"2024-09-18T12:58:05.334716+0000","last_unstale":"2024-09-18T13:38:31.224340+0000","last_undegraded":"2024-09-18T13:38:31.224340+0000","last_fullsized":"2024-09-18T13:38:31.224340+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.226945+0000","last_change":"2024-09-18T12:58:07.299969+0000","last_active":"2024-09-18T13:38:31.226945+0000","last_peered":"2024-09-18T13:38:31.226945+0000","last_clean":"2024-09-18T13:38:31.226945+0000","last_became_active":"2024-09-18T12:58:05.367264+0000","last_became_peered":"2024-09-18T12:58:05.367264+0000","last_unstale":"2024-09-18T13:38:31.226945+0000","last_undegraded":"2024-09-18T13:38:31.226945+0000","last_fullsized":"2024-09-18T13:38:31.226945+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"13'2","reported_seq":1886,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.236281+0000","last_change":"2024-09-18T12:58:07.296152+0000","last_active":"2024-09-18T13:38:31.236281+0000","last_peered":"2024-09-18T13:38:31.236281+0000","last_clean":"2024-09-18T13:38:31.236281+0000","last_became_active":"2024-09-18T12:58:05.351346+0000","last_became_peered":"2024-09-18T12:58:05.351346+0000","last_unstale":"2024-09-18T13:38:31.236281+0000","last_undegraded":"2024-09-18T13:38:31.236281+0000","last_fullsized":"2024-09-18T13:38:31.236281+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.239122+0000","last_change":"2024-09-18T12:58:07.296880+0000","last_active":"2024-09-18T13:38:31.239122+0000","last_peered":"2024-09-18T13:38:31.239122+0000","last_clean":"2024-09-18T13:38:31.239122+0000","last_became_active":"2024-09-18T12:58:05.380953+0000","last_became_peered":"2024-09-18T12:58:05.380953+0000","last_unstale":"2024-09-18T13:38:31.239122+0000","last_undegraded":"2024-09-18T13:38:31.239122+0000","last_fullsized":"2024-09-18T13:38:31.239122+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.232611+0000","last_change":"2024-09-18T12:58:07.296003+0000","last_active":"2024-09-18T13:38:31.232611+0000","last_peered":"2024-09-18T13:38:31.232611+0000","last_clean":"2024-09-18T13:38:31.232611+0000","last_became_active":"2024-09-18T12:58:05.356265+0000","last_became_peered":"2024-09-18T12:58:05.356265+0000","last_unstale":"2024-09-18T13:38:31.232611+0000","last_undegraded":"2024-09-18T13:38:31.232611+0000","last_fullsized":"2024-09-18T13:38:31.232611+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"11'1","reported_seq":1885,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.241186+0000","last_change":"2024-09-18T12:58:07.300851+0000","last_active":"2024-09-18T13:38:31.241186+0000","last_peered":"2024-09-18T13:38:31.241186+0000","last_clean":"2024-09-18T13:38:31.241186+0000","last_became_active":"2024-09-18T12:58:05.338947+0000","last_became_peered":"2024-09-18T12:58:05.338947+0000","last_unstale":"2024-09-18T13:38:31.241186+0000","last_undegraded":"2024-09-18T13:38:31.241186+0000","last_fullsized":"2024-09-18T13:38:31.241186+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":1953,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.223194+0000","last_change":"2024-09-18T12:58:04.328557+0000","last_active":"2024-09-18T13:38:31.223194+0000","last_peered":"2024-09-18T13:38:31.223194+0000","last_clean":"2024-09-18T13:38:31.223194+0000","last_became_active":"2024-09-18T12:58:04.317289+0000","last_became_peered":"2024-09-18T12:58:04.317289+0000","last_unstale":"2024-09-18T13:38:31.223194+0000","last_undegraded":"2024-09-18T13:38:31.223194+0000","last_fullsized":"2024-09-18T13:38:31.223194+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:03.253584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:03.253584+0000","last_clean_scrub_stamp":"2024-09-18T12:58:03.253584+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740791,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69476,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302364,"statfs":{"total":96636764160,"available":96565620736,"internally_reserved":0,"allocated":2445312,"data_stored":1118339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740791,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69544,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302296,"statfs":{"total":96636764160,"available":96565551104,"internally_reserved":0,"allocated":2514944,"data_stored":1708723,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359740789,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69516,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302324,"statfs":{"total":96636764160,"available":96565579776,"internally_reserved":0,"allocated":2486272,"data_stored":1708591,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T13:38:34.472 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T13:38:34.472 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T13:38:34.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:34.576+0000 7f2c0e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:34.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:34.583+0000 7f2c0e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:34.771 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T13:38:34.772 INFO:teuthology.orchestra.run.smithi178.stderr:dumped all 2024-09-18T13:38:34.785 INFO:teuthology.orchestra.run.smithi178.stdout:{"pg_ready":true,"pg_map":{"version":1847,"stamp":"2024-09-18T13:38:34.040521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":208536,"kb_used_data":7272,"kb_used_omap":0,"kb_used_meta":201216,"kb_avail":282906984,"statfs":{"total":289910292480,"available":289696751616,"internally_reserved":0,"allocated":7446528,"data_stored":4535653,"data_compressed":59988,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":206045184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.000821"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.225502+0000","last_change":"2024-09-18T12:58:07.294450+0000","last_active":"2024-09-18T13:38:31.225502+0000","last_peered":"2024-09-18T13:38:31.225502+0000","last_clean":"2024-09-18T13:38:31.225502+0000","last_became_active":"2024-09-18T12:58:05.359472+0000","last_became_peered":"2024-09-18T12:58:05.359472+0000","last_unstale":"2024-09-18T13:38:31.225502+0000","last_undegraded":"2024-09-18T13:38:31.225502+0000","last_fullsized":"2024-09-18T13:38:31.225502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.231997+0000","last_change":"2024-09-18T12:58:07.301180+0000","last_active":"2024-09-18T13:38:31.231997+0000","last_peered":"2024-09-18T13:38:31.231997+0000","last_clean":"2024-09-18T13:38:31.231997+0000","last_became_active":"2024-09-18T12:58:05.381352+0000","last_became_peered":"2024-09-18T12:58:05.381352+0000","last_unstale":"2024-09-18T13:38:31.231997+0000","last_undegraded":"2024-09-18T13:38:31.231997+0000","last_fullsized":"2024-09-18T13:38:31.231997+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.224340+0000","last_change":"2024-09-18T12:58:07.293981+0000","last_active":"2024-09-18T13:38:31.224340+0000","last_peered":"2024-09-18T13:38:31.224340+0000","last_clean":"2024-09-18T13:38:31.224340+0000","last_became_active":"2024-09-18T12:58:05.334716+0000","last_became_peered":"2024-09-18T12:58:05.334716+0000","last_unstale":"2024-09-18T13:38:31.224340+0000","last_undegraded":"2024-09-18T13:38:31.224340+0000","last_fullsized":"2024-09-18T13:38:31.224340+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.226945+0000","last_change":"2024-09-18T12:58:07.299969+0000","last_active":"2024-09-18T13:38:31.226945+0000","last_peered":"2024-09-18T13:38:31.226945+0000","last_clean":"2024-09-18T13:38:31.226945+0000","last_became_active":"2024-09-18T12:58:05.367264+0000","last_became_peered":"2024-09-18T12:58:05.367264+0000","last_unstale":"2024-09-18T13:38:31.226945+0000","last_undegraded":"2024-09-18T13:38:31.226945+0000","last_fullsized":"2024-09-18T13:38:31.226945+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"13'2","reported_seq":1886,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.236281+0000","last_change":"2024-09-18T12:58:07.296152+0000","last_active":"2024-09-18T13:38:31.236281+0000","last_peered":"2024-09-18T13:38:31.236281+0000","last_clean":"2024-09-18T13:38:31.236281+0000","last_became_active":"2024-09-18T12:58:05.351346+0000","last_became_peered":"2024-09-18T12:58:05.351346+0000","last_unstale":"2024-09-18T13:38:31.236281+0000","last_undegraded":"2024-09-18T13:38:31.236281+0000","last_fullsized":"2024-09-18T13:38:31.236281+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.239122+0000","last_change":"2024-09-18T12:58:07.296880+0000","last_active":"2024-09-18T13:38:31.239122+0000","last_peered":"2024-09-18T13:38:31.239122+0000","last_clean":"2024-09-18T13:38:31.239122+0000","last_became_active":"2024-09-18T12:58:05.380953+0000","last_became_peered":"2024-09-18T12:58:05.380953+0000","last_unstale":"2024-09-18T13:38:31.239122+0000","last_undegraded":"2024-09-18T13:38:31.239122+0000","last_fullsized":"2024-09-18T13:38:31.239122+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.232611+0000","last_change":"2024-09-18T12:58:07.296003+0000","last_active":"2024-09-18T13:38:31.232611+0000","last_peered":"2024-09-18T13:38:31.232611+0000","last_clean":"2024-09-18T13:38:31.232611+0000","last_became_active":"2024-09-18T12:58:05.356265+0000","last_became_peered":"2024-09-18T12:58:05.356265+0000","last_unstale":"2024-09-18T13:38:31.232611+0000","last_undegraded":"2024-09-18T13:38:31.232611+0000","last_fullsized":"2024-09-18T13:38:31.232611+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"11'1","reported_seq":1885,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.241186+0000","last_change":"2024-09-18T12:58:07.300851+0000","last_active":"2024-09-18T13:38:31.241186+0000","last_peered":"2024-09-18T13:38:31.241186+0000","last_clean":"2024-09-18T13:38:31.241186+0000","last_became_active":"2024-09-18T12:58:05.338947+0000","last_became_peered":"2024-09-18T12:58:05.338947+0000","last_unstale":"2024-09-18T13:38:31.241186+0000","last_undegraded":"2024-09-18T13:38:31.241186+0000","last_fullsized":"2024-09-18T13:38:31.241186+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":1953,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.223194+0000","last_change":"2024-09-18T12:58:04.328557+0000","last_active":"2024-09-18T13:38:31.223194+0000","last_peered":"2024-09-18T13:38:31.223194+0000","last_clean":"2024-09-18T13:38:31.223194+0000","last_became_active":"2024-09-18T12:58:04.317289+0000","last_became_peered":"2024-09-18T12:58:04.317289+0000","last_unstale":"2024-09-18T13:38:31.223194+0000","last_undegraded":"2024-09-18T13:38:31.223194+0000","last_fullsized":"2024-09-18T13:38:31.223194+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:03.253584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:03.253584+0000","last_clean_scrub_stamp":"2024-09-18T12:58:03.253584+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740791,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69476,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302364,"statfs":{"total":96636764160,"available":96565620736,"internally_reserved":0,"allocated":2445312,"data_stored":1118339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740791,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69544,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302296,"statfs":{"total":96636764160,"available":96565551104,"internally_reserved":0,"allocated":2514944,"data_stored":1708723,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359740789,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69516,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302324,"statfs":{"total":96636764160,"available":96565579776,"internally_reserved":0,"allocated":2486272,"data_stored":1708591,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T13:38:34.786 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T13:38:34.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:34.890+0000 7fe238d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:34.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:34.897+0000 7fe238d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:35.085 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T13:38:35.085 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":638,"fsid":"ef2e64fd-507f-40d9-bf22-5b28c8ab36ed","created":"2024-09-18T12:57:53.632189+0000","modified":"2024-09-18T13:38:34.039456+0000","last_up_change":"2024-09-18T12:58:02.247814+0000","last_in_change":"2024-09-18T12:57:55.513443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":45,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:58:02.263663+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T12:58:03.462613+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"51c42150-67df-4e25-8bce-f32fe9d38bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":633,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":3869263817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3869263817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3869263817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":3869263817}]},"public_addr":"172.21.15.178:6803/3869263817","cluster_addr":"172.21.15.178:6802/3869263817","heartbeat_back_addr":"172.21.15.178:6812/3869263817","heartbeat_front_addr":"172.21.15.178:6811/3869263817","state":["exists","up"]},{"osd":1,"uuid":"9df4c8a5-d349-420e-a0eb-ab72306f3279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":633,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2713647840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":2713647840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2713647840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":2713647840}]},"public_addr":"172.21.15.178:6806/2713647840","cluster_addr":"172.21.15.178:6807/2713647840","heartbeat_back_addr":"172.21.15.178:6809/2713647840","heartbeat_front_addr":"172.21.15.178:6808/2713647840","state":["exists","up"]},{"osd":2,"uuid":"7acc6422-dacf-4fbf-8af5-0aa6c374be4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":633,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":4169439159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":4169439159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":4169439159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":4169439159}]},"public_addr":"172.21.15.178:6804/4169439159","cluster_addr":"172.21.15.178:6805/4169439159","heartbeat_back_addr":"172.21.15.178:6810/4169439159","heartbeat_front_addr":"172.21.15.178:6813/4169439159","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":3,"snaps":[{"begin":2,"length":3},{"begin":7,"length":11},{"begin":23,"length":4},{"begin":37,"length":1},{"begin":41,"length":1},{"begin":44,"length":2},{"begin":69,"length":1},{"begin":71,"length":1}]},{"pool":4,"snaps":[{"begin":2,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1}]},{"pool":6,"snaps":[{"begin":2,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":1}]},{"pool":9,"snaps":[{"begin":2,"length":1}]},{"pool":10,"snaps":[{"begin":2,"length":4}]},{"pool":11,"snaps":[{"begin":2,"length":1}]},{"pool":12,"snaps":[{"begin":2,"length":1}]},{"pool":13,"snaps":[{"begin":2,"length":1}]},{"pool":14,"snaps":[{"begin":2,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":1}]},{"pool":17,"snaps":[{"begin":2,"length":1}]},{"pool":18,"snaps":[{"begin":2,"length":2}]},{"pool":19,"snaps":[{"begin":2,"length":1}]},{"pool":20,"snaps":[{"begin":2,"length":1}]},{"pool":21,"snaps":[{"begin":2,"length":1}]},{"pool":22,"snaps":[{"begin":2,"length":3}]},{"pool":23,"snaps":[{"begin":2,"length":9}]},{"pool":24,"snaps":[{"begin":2,"length":1}]},{"pool":25,"snaps":[{"begin":2,"length":1}]},{"pool":26,"snaps":[{"begin":2,"length":1}]},{"pool":27,"snaps":[{"begin":2,"length":1}]},{"pool":28,"snaps":[{"begin":2,"length":1}]},{"pool":29,"snaps":[{"begin":2,"length":1}]},{"pool":30,"snaps":[{"begin":2,"length":1}]},{"pool":31,"snaps":[{"begin":2,"length":1}]},{"pool":32,"snaps":[{"begin":2,"length":1}]},{"pool":33,"snaps":[{"begin":2,"length":7},{"begin":14,"length":2},{"begin":19,"length":1}]},{"pool":34,"snaps":[{"begin":2,"length":46}]},{"pool":35,"snaps":[{"begin":2,"length":13}]},{"pool":38,"snaps":[{"begin":2,"length":3}]},{"pool":39,"snaps":[{"begin":2,"length":3}]},{"pool":40,"snaps":[{"begin":2,"length":1}]},{"pool":41,"snaps":[{"begin":2,"length":1}]},{"pool":42,"snaps":[{"begin":2,"length":1}]},{"pool":43,"snaps":[{"begin":2,"length":1}]},{"pool":44,"snaps":[{"begin":2,"length":1}]},{"pool":45,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T13:38:36.099 INFO:tasks.ceph:Scrubbing osd.0 2024-09-18T13:38:36.100 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-18T13:38:36.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:36.205+0000 7f6e7566c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:36.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:36.218+0000 7f6e7566c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:36.235 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-09-18T13:38:36.235 INFO:teuthology.orchestra.run.smithi178.stdout: "success": "" 2024-09-18T13:38:36.235 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-09-18T13:38:36.247 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-18T13:38:36.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:36.350+0000 7f905dd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:36.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:36.358+0000 7f905dd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:36.548 INFO:teuthology.orchestra.run.smithi178.stderr:instructed osd(s) 0 to deep-scrub 2024-09-18T13:38:36.566 INFO:tasks.ceph:Scrubbing osd.1 2024-09-18T13:38:36.566 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-18T13:38:36.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:36.670+0000 7f3ab6111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:36.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:36.682+0000 7f3ab6111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:36.698 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-09-18T13:38:36.699 INFO:teuthology.orchestra.run.smithi178.stdout: "success": "" 2024-09-18T13:38:36.699 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-09-18T13:38:36.711 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-18T13:38:36.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:36.815+0000 7fc0c6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:36.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:36.823+0000 7fc0c6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:37.012 INFO:teuthology.orchestra.run.smithi178.stderr:instructed osd(s) 1 to deep-scrub 2024-09-18T13:38:37.030 INFO:tasks.ceph:Scrubbing osd.2 2024-09-18T13:38:37.030 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-18T13:38:37.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:37.140+0000 7fafd0a97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:37.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:37.152+0000 7fafd0a97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:37.168 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-09-18T13:38:37.168 INFO:teuthology.orchestra.run.smithi178.stdout: "success": "" 2024-09-18T13:38:37.169 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-09-18T13:38:37.180 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-18T13:38:37.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:37.284+0000 7f6282f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:37.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:37.291+0000 7f6282f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:37.478 INFO:teuthology.orchestra.run.smithi178.stderr:instructed osd(s) 2 to deep-scrub 2024-09-18T13:38:37.496 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T13:38:37.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:37.600+0000 7f1ef5308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:37.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:37.607+0000 7f1ef5308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:37.798 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T13:38:37.798 INFO:teuthology.orchestra.run.smithi178.stderr:dumped all 2024-09-18T13:38:37.811 INFO:teuthology.orchestra.run.smithi178.stdout:{"pg_ready":true,"pg_map":{"version":1849,"stamp":"2024-09-18T13:38:36.868227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":208536,"kb_used_data":7272,"kb_used_omap":0,"kb_used_meta":201216,"kb_avail":282906984,"statfs":{"total":289910292480,"available":289696751616,"internally_reserved":0,"allocated":7446528,"data_stored":4535653,"data_compressed":59988,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":206045184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001284"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.225502+0000","last_change":"2024-09-18T12:58:07.294450+0000","last_active":"2024-09-18T13:38:31.225502+0000","last_peered":"2024-09-18T13:38:31.225502+0000","last_clean":"2024-09-18T13:38:31.225502+0000","last_became_active":"2024-09-18T12:58:05.359472+0000","last_became_peered":"2024-09-18T12:58:05.359472+0000","last_unstale":"2024-09-18T13:38:31.225502+0000","last_undegraded":"2024-09-18T13:38:31.225502+0000","last_fullsized":"2024-09-18T13:38:31.225502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.231997+0000","last_change":"2024-09-18T12:58:07.301180+0000","last_active":"2024-09-18T13:38:31.231997+0000","last_peered":"2024-09-18T13:38:31.231997+0000","last_clean":"2024-09-18T13:38:31.231997+0000","last_became_active":"2024-09-18T12:58:05.381352+0000","last_became_peered":"2024-09-18T12:58:05.381352+0000","last_unstale":"2024-09-18T13:38:31.231997+0000","last_undegraded":"2024-09-18T13:38:31.231997+0000","last_fullsized":"2024-09-18T13:38:31.231997+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.224340+0000","last_change":"2024-09-18T12:58:07.293981+0000","last_active":"2024-09-18T13:38:31.224340+0000","last_peered":"2024-09-18T13:38:31.224340+0000","last_clean":"2024-09-18T13:38:31.224340+0000","last_became_active":"2024-09-18T12:58:05.334716+0000","last_became_peered":"2024-09-18T12:58:05.334716+0000","last_unstale":"2024-09-18T13:38:31.224340+0000","last_undegraded":"2024-09-18T13:38:31.224340+0000","last_fullsized":"2024-09-18T13:38:31.224340+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.226945+0000","last_change":"2024-09-18T12:58:07.299969+0000","last_active":"2024-09-18T13:38:31.226945+0000","last_peered":"2024-09-18T13:38:31.226945+0000","last_clean":"2024-09-18T13:38:31.226945+0000","last_became_active":"2024-09-18T12:58:05.367264+0000","last_became_peered":"2024-09-18T12:58:05.367264+0000","last_unstale":"2024-09-18T13:38:31.226945+0000","last_undegraded":"2024-09-18T13:38:31.226945+0000","last_fullsized":"2024-09-18T13:38:31.226945+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"13'2","reported_seq":1886,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.236281+0000","last_change":"2024-09-18T12:58:07.296152+0000","last_active":"2024-09-18T13:38:31.236281+0000","last_peered":"2024-09-18T13:38:31.236281+0000","last_clean":"2024-09-18T13:38:31.236281+0000","last_became_active":"2024-09-18T12:58:05.351346+0000","last_became_peered":"2024-09-18T12:58:05.351346+0000","last_unstale":"2024-09-18T13:38:31.236281+0000","last_undegraded":"2024-09-18T13:38:31.236281+0000","last_fullsized":"2024-09-18T13:38:31.236281+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.239122+0000","last_change":"2024-09-18T12:58:07.296880+0000","last_active":"2024-09-18T13:38:31.239122+0000","last_peered":"2024-09-18T13:38:31.239122+0000","last_clean":"2024-09-18T13:38:31.239122+0000","last_became_active":"2024-09-18T12:58:05.380953+0000","last_became_peered":"2024-09-18T12:58:05.380953+0000","last_unstale":"2024-09-18T13:38:31.239122+0000","last_undegraded":"2024-09-18T13:38:31.239122+0000","last_fullsized":"2024-09-18T13:38:31.239122+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.232611+0000","last_change":"2024-09-18T12:58:07.296003+0000","last_active":"2024-09-18T13:38:31.232611+0000","last_peered":"2024-09-18T13:38:31.232611+0000","last_clean":"2024-09-18T13:38:31.232611+0000","last_became_active":"2024-09-18T12:58:05.356265+0000","last_became_peered":"2024-09-18T12:58:05.356265+0000","last_unstale":"2024-09-18T13:38:31.232611+0000","last_undegraded":"2024-09-18T13:38:31.232611+0000","last_fullsized":"2024-09-18T13:38:31.232611+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"11'1","reported_seq":1885,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.241186+0000","last_change":"2024-09-18T12:58:07.300851+0000","last_active":"2024-09-18T13:38:31.241186+0000","last_peered":"2024-09-18T13:38:31.241186+0000","last_clean":"2024-09-18T13:38:31.241186+0000","last_became_active":"2024-09-18T12:58:05.338947+0000","last_became_peered":"2024-09-18T12:58:05.338947+0000","last_unstale":"2024-09-18T13:38:31.241186+0000","last_undegraded":"2024-09-18T13:38:31.241186+0000","last_fullsized":"2024-09-18T13:38:31.241186+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":1953,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.223194+0000","last_change":"2024-09-18T12:58:04.328557+0000","last_active":"2024-09-18T13:38:31.223194+0000","last_peered":"2024-09-18T13:38:31.223194+0000","last_clean":"2024-09-18T13:38:31.223194+0000","last_became_active":"2024-09-18T12:58:04.317289+0000","last_became_peered":"2024-09-18T12:58:04.317289+0000","last_unstale":"2024-09-18T13:38:31.223194+0000","last_undegraded":"2024-09-18T13:38:31.223194+0000","last_fullsized":"2024-09-18T13:38:31.223194+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:03.253584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:03.253584+0000","last_clean_scrub_stamp":"2024-09-18T12:58:03.253584+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740791,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69476,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302364,"statfs":{"total":96636764160,"available":96565620736,"internally_reserved":0,"allocated":2445312,"data_stored":1118339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740791,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69544,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302296,"statfs":{"total":96636764160,"available":96565551104,"internally_reserved":0,"allocated":2514944,"data_stored":1708723,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359740789,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69516,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302324,"statfs":{"total":96636764160,"available":96565579776,"internally_reserved":0,"allocated":2486272,"data_stored":1708591,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T13:38:37.815 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:37.815 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:37.815 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:37.815 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:37.816 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:37.816 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:37.816 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:37.816 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:37.816 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T12:58:03.253584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:37.816 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T13:38:57.818 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T13:38:57.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:57.935+0000 7f3fbe191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:57.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:38:57.943+0000 7f3fbe191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:38:58.129 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T13:38:58.130 INFO:teuthology.orchestra.run.smithi178.stderr:dumped all 2024-09-18T13:38:58.143 INFO:teuthology.orchestra.run.smithi178.stdout:{"pg_ready":true,"pg_map":{"version":1859,"stamp":"2024-09-18T13:38:56.873099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":208536,"kb_used_data":7272,"kb_used_omap":0,"kb_used_meta":201216,"kb_avail":282906984,"statfs":{"total":289910292480,"available":289696751616,"internally_reserved":0,"allocated":7446528,"data_stored":4535653,"data_compressed":59988,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":206045184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002809"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.225502+0000","last_change":"2024-09-18T12:58:07.294450+0000","last_active":"2024-09-18T13:38:31.225502+0000","last_peered":"2024-09-18T13:38:31.225502+0000","last_clean":"2024-09-18T13:38:31.225502+0000","last_became_active":"2024-09-18T12:58:05.359472+0000","last_became_peered":"2024-09-18T12:58:05.359472+0000","last_unstale":"2024-09-18T13:38:31.225502+0000","last_undegraded":"2024-09-18T13:38:31.225502+0000","last_fullsized":"2024-09-18T13:38:31.225502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.231997+0000","last_change":"2024-09-18T12:58:07.301180+0000","last_active":"2024-09-18T13:38:31.231997+0000","last_peered":"2024-09-18T13:38:31.231997+0000","last_clean":"2024-09-18T13:38:31.231997+0000","last_became_active":"2024-09-18T12:58:05.381352+0000","last_became_peered":"2024-09-18T12:58:05.381352+0000","last_unstale":"2024-09-18T13:38:31.231997+0000","last_undegraded":"2024-09-18T13:38:31.231997+0000","last_fullsized":"2024-09-18T13:38:31.231997+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.224340+0000","last_change":"2024-09-18T12:58:07.293981+0000","last_active":"2024-09-18T13:38:31.224340+0000","last_peered":"2024-09-18T13:38:31.224340+0000","last_clean":"2024-09-18T13:38:31.224340+0000","last_became_active":"2024-09-18T12:58:05.334716+0000","last_became_peered":"2024-09-18T12:58:05.334716+0000","last_unstale":"2024-09-18T13:38:31.224340+0000","last_undegraded":"2024-09-18T13:38:31.224340+0000","last_fullsized":"2024-09-18T13:38:31.224340+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.226945+0000","last_change":"2024-09-18T12:58:07.299969+0000","last_active":"2024-09-18T13:38:31.226945+0000","last_peered":"2024-09-18T13:38:31.226945+0000","last_clean":"2024-09-18T13:38:31.226945+0000","last_became_active":"2024-09-18T12:58:05.367264+0000","last_became_peered":"2024-09-18T12:58:05.367264+0000","last_unstale":"2024-09-18T13:38:31.226945+0000","last_undegraded":"2024-09-18T13:38:31.226945+0000","last_fullsized":"2024-09-18T13:38:31.226945+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"13'2","reported_seq":1886,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.236281+0000","last_change":"2024-09-18T12:58:07.296152+0000","last_active":"2024-09-18T13:38:31.236281+0000","last_peered":"2024-09-18T13:38:31.236281+0000","last_clean":"2024-09-18T13:38:31.236281+0000","last_became_active":"2024-09-18T12:58:05.351346+0000","last_became_peered":"2024-09-18T12:58:05.351346+0000","last_unstale":"2024-09-18T13:38:31.236281+0000","last_undegraded":"2024-09-18T13:38:31.236281+0000","last_fullsized":"2024-09-18T13:38:31.236281+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.239122+0000","last_change":"2024-09-18T12:58:07.296880+0000","last_active":"2024-09-18T13:38:31.239122+0000","last_peered":"2024-09-18T13:38:31.239122+0000","last_clean":"2024-09-18T13:38:31.239122+0000","last_became_active":"2024-09-18T12:58:05.380953+0000","last_became_peered":"2024-09-18T12:58:05.380953+0000","last_unstale":"2024-09-18T13:38:31.239122+0000","last_undegraded":"2024-09-18T13:38:31.239122+0000","last_fullsized":"2024-09-18T13:38:31.239122+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1884,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.232611+0000","last_change":"2024-09-18T12:58:07.296003+0000","last_active":"2024-09-18T13:38:31.232611+0000","last_peered":"2024-09-18T13:38:31.232611+0000","last_clean":"2024-09-18T13:38:31.232611+0000","last_became_active":"2024-09-18T12:58:05.356265+0000","last_became_peered":"2024-09-18T12:58:05.356265+0000","last_unstale":"2024-09-18T13:38:31.232611+0000","last_undegraded":"2024-09-18T13:38:31.232611+0000","last_fullsized":"2024-09-18T13:38:31.232611+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"11'1","reported_seq":1885,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.241186+0000","last_change":"2024-09-18T12:58:07.300851+0000","last_active":"2024-09-18T13:38:31.241186+0000","last_peered":"2024-09-18T13:38:31.241186+0000","last_clean":"2024-09-18T13:38:31.241186+0000","last_became_active":"2024-09-18T12:58:05.338947+0000","last_became_peered":"2024-09-18T12:58:05.338947+0000","last_unstale":"2024-09-18T13:38:31.241186+0000","last_undegraded":"2024-09-18T13:38:31.241186+0000","last_fullsized":"2024-09-18T13:38:31.241186+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:04.257078+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":1953,"reported_epoch":636,"state":"active+clean","last_fresh":"2024-09-18T13:38:31.223194+0000","last_change":"2024-09-18T12:58:04.328557+0000","last_active":"2024-09-18T13:38:31.223194+0000","last_peered":"2024-09-18T13:38:31.223194+0000","last_clean":"2024-09-18T13:38:31.223194+0000","last_became_active":"2024-09-18T12:58:04.317289+0000","last_became_peered":"2024-09-18T12:58:04.317289+0000","last_unstale":"2024-09-18T13:38:31.223194+0000","last_undegraded":"2024-09-18T13:38:31.223194+0000","last_fullsized":"2024-09-18T13:38:31.223194+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:58:03.253584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:58:03.253584+0000","last_clean_scrub_stamp":"2024-09-18T12:58:03.253584+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740791,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69476,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302364,"statfs":{"total":96636764160,"available":96565620736,"internally_reserved":0,"allocated":2445312,"data_stored":1118339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740791,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69544,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302296,"statfs":{"total":96636764160,"available":96565551104,"internally_reserved":0,"allocated":2514944,"data_stored":1708723,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359740789,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69516,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302324,"statfs":{"total":96636764160,"available":96565579776,"internally_reserved":0,"allocated":2486272,"data_stored":1708591,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T13:38:58.144 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:58.144 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:58.144 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:58.144 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:58.144 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:58.144 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:58.144 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:58.145 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T12:58:04.257078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:58.145 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T12:58:03.253584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=58, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:38:58.145 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T13:39:18.146 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T13:39:18.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:39:18.263+0000 7ffa46ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:39:18.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:39:18.271+0000 7ffa46ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:39:18.460 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-18T13:39:18.460 INFO:teuthology.orchestra.run.smithi178.stderr:dumped all 2024-09-18T13:39:18.473 INFO:teuthology.orchestra.run.smithi178.stdout:{"pg_ready":true,"pg_map":{"version":1869,"stamp":"2024-09-18T13:39:16.878078+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":230656,"kb_used_data":7184,"kb_used_omap":0,"kb_used_meta":223424,"kb_avail":282884864,"statfs":{"total":289910292480,"available":289674100736,"internally_reserved":0,"allocated":7356416,"data_stored":4558930,"data_compressed":59988,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":228786176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003037"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1892,"reported_epoch":638,"state":"active+clean","last_fresh":"2024-09-18T13:38:37.017244+0000","last_change":"2024-09-18T13:38:37.079520+0000","last_active":"2024-09-18T13:38:37.017244+0000","last_peered":"2024-09-18T13:38:37.017244+0000","last_clean":"2024-09-18T13:38:37.017244+0000","last_became_active":"2024-09-18T12:58:05.359472+0000","last_became_peered":"2024-09-18T12:58:05.359472+0000","last_unstale":"2024-09-18T13:38:37.017244+0000","last_undegraded":"2024-09-18T13:38:37.017244+0000","last_fullsized":"2024-09-18T13:38:37.017244+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:38:37.079312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:38:37.079312+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1892,"reported_epoch":638,"state":"active+clean","last_fresh":"2024-09-18T13:38:37.020164+0000","last_change":"2024-09-18T13:38:37.038401+0000","last_active":"2024-09-18T13:38:37.020164+0000","last_peered":"2024-09-18T13:38:37.020164+0000","last_clean":"2024-09-18T13:38:37.020164+0000","last_became_active":"2024-09-18T12:58:05.381352+0000","last_became_peered":"2024-09-18T12:58:05.381352+0000","last_unstale":"2024-09-18T13:38:37.020164+0000","last_undegraded":"2024-09-18T13:38:37.020164+0000","last_fullsized":"2024-09-18T13:38:37.020164+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:38:37.038111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:38:37.038111+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1892,"reported_epoch":638,"state":"active+clean","last_fresh":"2024-09-18T13:38:37.016051+0000","last_change":"2024-09-18T13:38:37.072726+0000","last_active":"2024-09-18T13:38:37.016051+0000","last_peered":"2024-09-18T13:38:37.016051+0000","last_clean":"2024-09-18T13:38:37.016051+0000","last_became_active":"2024-09-18T12:58:05.334716+0000","last_became_peered":"2024-09-18T12:58:05.334716+0000","last_unstale":"2024-09-18T13:38:37.016051+0000","last_undegraded":"2024-09-18T13:38:37.016051+0000","last_fullsized":"2024-09-18T13:38:37.016051+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:38:37.072455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:38:37.072455+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1892,"reported_epoch":638,"state":"active+clean","last_fresh":"2024-09-18T13:38:37.016908+0000","last_change":"2024-09-18T13:38:37.031798+0000","last_active":"2024-09-18T13:38:37.016908+0000","last_peered":"2024-09-18T13:38:37.016908+0000","last_clean":"2024-09-18T13:38:37.016908+0000","last_became_active":"2024-09-18T12:58:05.367264+0000","last_became_peered":"2024-09-18T12:58:05.367264+0000","last_unstale":"2024-09-18T13:38:37.016908+0000","last_undegraded":"2024-09-18T13:38:37.016908+0000","last_fullsized":"2024-09-18T13:38:37.016908+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:38:37.031510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:38:37.031510+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"13'2","reported_seq":1894,"reported_epoch":638,"state":"active+clean","last_fresh":"2024-09-18T13:38:36.550433+0000","last_change":"2024-09-18T13:38:36.561047+0000","last_active":"2024-09-18T13:38:36.550433+0000","last_peered":"2024-09-18T13:38:36.550433+0000","last_clean":"2024-09-18T13:38:36.550433+0000","last_became_active":"2024-09-18T12:58:05.351346+0000","last_became_peered":"2024-09-18T12:58:05.351346+0000","last_unstale":"2024-09-18T13:38:36.550433+0000","last_undegraded":"2024-09-18T13:38:36.550433+0000","last_fullsized":"2024-09-18T13:38:36.550433+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'2","last_scrub_stamp":"2024-09-18T13:38:36.560872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:38:36.560872+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1892,"reported_epoch":638,"state":"active+clean","last_fresh":"2024-09-18T13:38:37.481788+0000","last_change":"2024-09-18T13:38:37.491046+0000","last_active":"2024-09-18T13:38:37.481788+0000","last_peered":"2024-09-18T13:38:37.481788+0000","last_clean":"2024-09-18T13:38:37.481788+0000","last_became_active":"2024-09-18T12:58:05.380953+0000","last_became_peered":"2024-09-18T12:58:05.380953+0000","last_unstale":"2024-09-18T13:38:37.481788+0000","last_undegraded":"2024-09-18T13:38:37.481788+0000","last_fullsized":"2024-09-18T13:38:37.481788+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:38:37.490767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:38:37.490767+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1892,"reported_epoch":638,"state":"active+clean","last_fresh":"2024-09-18T13:38:37.480442+0000","last_change":"2024-09-18T13:38:37.489007+0000","last_active":"2024-09-18T13:38:37.480442+0000","last_peered":"2024-09-18T13:38:37.480442+0000","last_clean":"2024-09-18T13:38:37.480442+0000","last_became_active":"2024-09-18T12:58:05.356265+0000","last_became_peered":"2024-09-18T12:58:05.356265+0000","last_unstale":"2024-09-18T13:38:37.480442+0000","last_undegraded":"2024-09-18T13:38:37.480442+0000","last_fullsized":"2024-09-18T13:38:37.480442+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:38:37.488835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:38:37.488835+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"11'1","reported_seq":1893,"reported_epoch":638,"state":"active+clean","last_fresh":"2024-09-18T13:38:37.015753+0000","last_change":"2024-09-18T13:38:37.083265+0000","last_active":"2024-09-18T13:38:37.015753+0000","last_peered":"2024-09-18T13:38:37.015753+0000","last_clean":"2024-09-18T13:38:37.015753+0000","last_became_active":"2024-09-18T12:58:05.338947+0000","last_became_peered":"2024-09-18T12:58:05.338947+0000","last_unstale":"2024-09-18T13:38:37.015753+0000","last_undegraded":"2024-09-18T13:38:37.015753+0000","last_fullsized":"2024-09-18T13:38:37.015753+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"11'1","last_scrub_stamp":"2024-09-18T13:38:37.083077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:38:37.083077+0000","last_clean_scrub_stamp":"2024-09-18T12:58:04.257078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":1961,"reported_epoch":638,"state":"active+clean","last_fresh":"2024-09-18T13:38:37.014056+0000","last_change":"2024-09-18T13:38:37.069497+0000","last_active":"2024-09-18T13:38:37.014056+0000","last_peered":"2024-09-18T13:38:37.014056+0000","last_clean":"2024-09-18T13:38:37.014056+0000","last_became_active":"2024-09-18T12:58:04.317289+0000","last_became_peered":"2024-09-18T12:58:04.317289+0000","last_unstale":"2024-09-18T13:38:37.014056+0000","last_undegraded":"2024-09-18T13:38:37.014056+0000","last_fullsized":"2024-09-18T13:38:37.014056+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"10'52","last_scrub_stamp":"2024-09-18T13:38:37.069150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:38:37.069150+0000","last_clean_scrub_stamp":"2024-09-18T12:58:03.253584+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740821,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69440,"kb_used_data":2352,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302400,"statfs":{"total":96636764160,"available":96565657600,"internally_reserved":0,"allocated":2408448,"data_stored":1126052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740820,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69504,"kb_used_data":2416,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302336,"statfs":{"total":96636764160,"available":96565592064,"internally_reserved":0,"allocated":2473984,"data_stored":1716439,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359740819,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91712,"kb_used_data":2416,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94280128,"statfs":{"total":96636764160,"available":96542851072,"internally_reserved":0,"allocated":2473984,"data_stored":1716439,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29994,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T13:39:18.475 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-18T13:39:18.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:39:18.574+0000 7f8a3a551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:39:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-18T13:39:18.584+0000 7f8a3a551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:39:18.795 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-18T13:39:18.795 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-18T13:39:18.795 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-18T13:39:18.795 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T13:39:18.885 INFO:tasks.ceph.osd.0:Stopped 2024-09-18T13:39:18.885 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-18T13:39:18.886 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T13:39:18.974 INFO:tasks.ceph.osd.1:Stopped 2024-09-18T13:39:18.974 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-18T13:39:18.975 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T13:39:19.059 INFO:tasks.ceph.osd.2:Stopped 2024-09-18T13:39:19.059 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-18T13:39:19.060 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-18T13:39:19.060 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T13:39:19.089 INFO:tasks.ceph.mgr.x:Stopped 2024-09-18T13:39:19.089 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-18T13:39:19.090 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-18T13:39:19.090 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T13:39:19.148 INFO:tasks.ceph.mon.a:Stopped 2024-09-18T13:39:19.149 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-18T13:39:19.149 DEBUG:teuthology.orchestra.run.smithi178:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'is full \(reached quota' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_FULL\)' | head -n 1 2024-09-18T13:39:19.224 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-18T13:39:19.225 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-18T13:39:19.413 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-18T13:39:19.414 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-18T13:39:19.536 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-18T13:39:19.536 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-18T13:39:19.603 INFO:tasks.ceph:Archiving mon data... 2024-09-18T13:39:19.604 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911397/data/mon.a.tgz 2024-09-18T13:39:19.604 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2024-09-18T13:39:19.622 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.op7BYfs7xo 2024-09-18T13:39:19.622 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.op7BYfs7xo 2024-09-18T13:39:19.769 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.op7BYfs7xo 2024-09-18T13:39:19.852 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.op7BYfs7xo is 316KB 2024-09-18T13:39:19.946 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.op7BYfs7xo 2024-09-18T13:39:19.961 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-18T13:39:19.961 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T13:39:20.080 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-18T13:39:20.080 INFO:tasks.ceph:Archiving crash dumps... 2024-09-18T13:39:20.082 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/crash to /home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911397/remote/smithi178/crash 2024-09-18T13:39:20.083 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T13:39:20.143 INFO:tasks.ceph:Compressing logs... 2024-09-18T13:39:20.143 DEBUG:teuthology.orchestra.run.smithi178:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T13:39:20.232 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-18T13:39:20.232 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70131.log 2024-09-18T13:39:20.232 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71190.log 2024-09-18T13:39:20.232 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.70131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71526.log 2024-09-18T13:39:20.232 INFO:teuthology.orchestra.run.smithi178.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.70131.log.gz 2024-09-18T13:39:20.232 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.71190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70692.log 2024-09-18T13:39:20.232 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.71190.log.gz 2024-09-18T13:39:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55215.log 2024-09-18T13:39:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.71526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30099.log 2024-09-18T13:39:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.70692.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.71526.log.gz 2024-09-18T13:39:20.233 INFO:teuthology.orchestra.run.smithi178.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.70692.log.gz 2024-09-18T13:39:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.55215.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-18T13:39:20.233 INFO:teuthology.orchestra.run.smithi178.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.55215.log.gz 2024-09-18T13:39:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.30099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71358.log 2024-09-18T13:39:20.233 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30099.log.gz 2024-09-18T13:39:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28768.log 2024-09-18T13:39:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.71358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65045.log 2024-09-18T13:39:20.233 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.71358.log.gz 2024-09-18T13:39:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.28768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28859.log 2024-09-18T13:39:20.233 INFO:teuthology.orchestra.run.smithi178.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28768.log.gz 2024-09-18T13:39:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.65045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29928.log 2024-09-18T13:39:20.234 INFO:teuthology.orchestra.run.smithi178.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.65045.log.gz 2024-09-18T13:39:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.28859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29637.log 2024-09-18T13:39:20.234 INFO:teuthology.orchestra.run.smithi178.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28859.log.gz 2024-09-18T13:39:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.29928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29929.log 2024-09-18T13:39:20.234 INFO:teuthology.orchestra.run.smithi178.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29928.log.gz 2024-09-18T13:39:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.29637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71692.log 2024-09-18T13:39:20.234 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29637.log.gz 2024-09-18T13:39:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.29929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71316.log 2024-09-18T13:39:20.234 INFO:teuthology.orchestra.run.smithi178.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29929.log.gz 2024-09-18T13:39:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.71692.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-18T13:39:20.234 INFO:teuthology.orchestra.run.smithi178.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.71692.log.gz 2024-09-18T13:39:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.71316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30317.log 2024-09-18T13:39:20.235 INFO:teuthology.orchestra.run.smithi178.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.71316.log.gz 2024-09-18T13:39:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30057.log 2024-09-18T13:39:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.30317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44568.log 2024-09-18T13:39:20.235 INFO:teuthology.orchestra.run.smithi178.stderr: 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-18T13:39:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.30057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71442.log 2024-09-18T13:39:20.235 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30057.log.gz 2024-09-18T13:39:20.235 INFO:teuthology.orchestra.run.smithi178.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.30317.log.gz 2024-09-18T13:39:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27189.log 2024-09-18T13:39:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.44568.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.44568.log.gz 2024-09-18T13:39:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.71442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29047.log 2024-09-18T13:39:20.235 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.71442.log.gz 2024-09-18T13:39:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph.tmp-client.admin.27189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71652.log 2024-09-18T13:39:20.236 INFO:teuthology.orchestra.run.smithi178.stderr: 66.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27189.log.gz 2024-09-18T13:39:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.29047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39100.log 2024-09-18T13:39:20.236 INFO:teuthology.orchestra.run.smithi178.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29047.log.gz 2024-09-18T13:39:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.71652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71400.log 2024-09-18T13:39:20.236 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.71652.log.gz 2024-09-18T13:39:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.39100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71010.log 2024-09-18T13:39:20.236 INFO:teuthology.orchestra.run.smithi178.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.39100.log.gz 2024-09-18T13:39:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.71400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29803.log 2024-09-18T13:39:20.236 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.71400.log.gz 2024-09-18T13:39:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.71010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28567.log 2024-09-18T13:39:20.236 INFO:teuthology.orchestra.run.smithi178.stderr: 76.8% -- replaced with /var/log/ceph/ceph-client.admin.71010.log.gz 2024-09-18T13:39:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.29803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29802.log 2024-09-18T13:39:20.237 INFO:teuthology.orchestra.run.smithi178.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29803.log.gz 2024-09-18T13:39:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.28567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30015.log 2024-09-18T13:39:20.237 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28567.log.gz 2024-09-18T13:39:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.29802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29525.log 2024-09-18T13:39:20.237 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29802.log.gz 2024-09-18T13:39:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.30015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71484.log 2024-09-18T13:39:20.237 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30015.log.gz 2024-09-18T13:39:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.29525.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-18T13:39:20.237 INFO:teuthology.orchestra.run.smithi178.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.29525.log.gz 2024-09-18T13:39:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.71484.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.39188.log 2024-09-18T13:39:20.237 INFO:teuthology.orchestra.run.smithi178.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71484.log.gz 2024-09-18T13:39:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29444.log 2024-09-18T13:39:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.39188.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-18T13:39:20.238 INFO:teuthology.orchestra.run.smithi178.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.39188.log.gz 2024-09-18T13:39:20.238 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29595.log 2024-09-18T13:39:20.238 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.29444.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29444.log.gz 2024-09-18T13:39:20.238 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44492.log 2024-09-18T13:39:20.238 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.29595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28655.log 2024-09-18T13:39:20.238 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29595.log.gz 2024-09-18T13:39:20.238 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.44492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71232.log 2024-09-18T13:39:20.238 INFO:teuthology.orchestra.run.smithi178.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.44492.log.gz 2024-09-18T13:39:20.238 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.28655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44648.log 2024-09-18T13:39:20.238 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28655.log.gz 2024-09-18T13:39:20.238 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.71232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49420.log 2024-09-18T13:39:20.238 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.71232.log.gz 2024-09-18T13:39:20.238 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.44648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29017.log 2024-09-18T13:39:20.239 INFO:teuthology.orchestra.run.smithi178.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.44648.log.gz 2024-09-18T13:39:20.239 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.49420.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-18T13:39:20.239 INFO:teuthology.orchestra.run.smithi178.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.49420.log.gz 2024-09-18T13:39:20.239 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.29017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70755.log 2024-09-18T13:39:20.239 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29017.log.gz 2024-09-18T13:39:20.239 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70859.log 2024-09-18T13:39:20.239 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.70755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71148.log 76.7% -- replaced with /var/log/ceph/ceph-client.admin.70755.log.gz 2024-09-18T13:39:20.239 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-09-18T13:39:20.239 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.70859.log: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.70859.log.gz 2024-09-18T13:39:20.239 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-18T13:39:20.239 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.71148.log: gzip -5 --verbose 49.2% -- replaced with /var/log/ceph/ceph-client.admin.71148.log.gz 2024-09-18T13:39:20.239 INFO:teuthology.orchestra.run.smithi178.stderr: -- /var/log/ceph/ceph-client.admin.70961.log 2024-09-18T13:39:20.239 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29679.log 2024-09-18T13:39:20.240 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.70961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29801.log 2024-09-18T13:39:20.240 INFO:teuthology.orchestra.run.smithi178.stderr: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.70961.log.gz 2024-09-18T13:39:20.240 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.29679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71610.log 2024-09-18T13:39:20.240 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.29801.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29679.log.gz 2024-09-18T13:39:20.240 INFO:teuthology.orchestra.run.smithi178.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29801.log.gz 2024-09-18T13:39:20.240 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28808.log 2024-09-18T13:39:20.240 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29721.log 2024-09-18T13:39:20.240 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.71610.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.71610.log.gz 2024-09-18T13:39:20.240 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.28808.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28808.log.gz 2024-09-18T13:39:20.240 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70909.log 2024-09-18T13:39:20.240 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71568.log 2024-09-18T13:39:20.240 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.29721.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29721.log.gz 2024-09-18T13:39:20.240 INFO:teuthology.orchestra.run.smithi178.stderr: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-18T13:39:20.241 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.70909.log: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.70909.log.gz 2024-09-18T13:39:20.241 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70065.log 2024-09-18T13:39:20.241 INFO:teuthology.orchestra.run.smithi178.stderr:gzip/var/log/ceph/ceph-client.admin.71568.log: 50.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.29927.log 2024-09-18T13:39:20.241 INFO:teuthology.orchestra.run.smithi178.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71568.log.gz/var/log/ceph/ceph-client.admin.70065.log: 2024-09-18T13:39:20.241 INFO:teuthology.orchestra.run.smithi178.stderr: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.70065.log.gz 2024-09-18T13:39:20.241 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71274.log 2024-09-18T13:39:20.241 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.29927.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29927.log.gz 2024-09-18T13:39:20.241 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70184.log 2024-09-18T13:39:20.241 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.71274.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.71274.log.gz 2024-09-18T13:39:20.241 INFO:teuthology.orchestra.run.smithi178.stderr: --verbose -- /var/log/ceph/ceph-client.admin.70807.log 2024-09-18T13:39:20.241 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.70184.log: gzip -5 --verbose 78.5% -- replaced with /var/log/ceph/ceph-client.admin.70184.log.gz 2024-09-18T13:39:20.241 INFO:teuthology.orchestra.run.smithi178.stderr: -- /var/log/ceph/ceph-client.admin.29500.log 2024-09-18T13:39:20.241 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.70807.log: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.70807.log.gz 2024-09-18T13:39:20.241 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.29500.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.29500.log.gz 2024-09-18T13:39:20.444 INFO:teuthology.orchestra.run.smithi178.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-18T13:39:21.210 INFO:teuthology.orchestra.run.smithi178.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-18T13:39:34.961 INFO:teuthology.orchestra.run.smithi178.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-18T13:39:36.126 INFO:teuthology.orchestra.run.smithi178.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-18T13:39:37.878 INFO:teuthology.orchestra.run.smithi178.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-18T13:39:37.880 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-09-18T13:39:37.880 INFO:teuthology.orchestra.run.smithi178.stderr:real 0m17.682s 2024-09-18T13:39:37.880 INFO:teuthology.orchestra.run.smithi178.stderr:user 0m47.467s 2024-09-18T13:39:37.880 INFO:teuthology.orchestra.run.smithi178.stderr:sys 0m2.032s 2024-09-18T13:39:37.881 INFO:tasks.ceph:Archiving logs... 2024-09-18T13:39:37.881 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/log/ceph to /home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911397/remote/smithi178/log 2024-09-18T13:39:37.882 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T13:39:44.758 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-18T13:39:44.768 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-18T13:39:44.768 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T13:39:44.824 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-18T13:39:44.832 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-18T13:39:44.832 DEBUG:teuthology.orchestra.run.smithi178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T13:39:44.855 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 1: ntpq: command not found 2024-09-18T13:39:44.859 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T13:39:44.859 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2024-09-18T13:39:44.859 INFO:teuthology.orchestra.run.smithi178.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 +548us[ +568us] +/- 40ms 2024-09-18T13:39:44.859 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 35 -2336us[-2315us] +/- 62ms 2024-09-18T13:39:44.859 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 +1712us[+1712us] +/- 67ms 2024-09-18T13:39:44.859 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T13:39:44.860 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-18T13:39:44.868 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-18T13:39:44.868 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-18T13:39:44.877 DEBUG:teuthology.orchestra.run.smithi178:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T13:39:44.968 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T13:39:44.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:39:44.997 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-18T13:39:45.006 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-18T13:39:45.030 INFO:teuthology.task.internal:Duration was 2914.291917 seconds 2024-09-18T13:39:45.030 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-18T13:39:45.039 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-18T13:39:45.039 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T13:39:45.079 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T13:39:45.372 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-18T13:39:45.372 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi178.front.sepia.ceph.com 2024-09-18T13:39:45.372 DEBUG:teuthology.orchestra.run.smithi178:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T13:39:45.433 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-18T13:39:45.434 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T13:39:45.501 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-18T13:39:45.501 DEBUG:teuthology.orchestra.run.smithi178:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T13:39:45.643 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-18T13:39:45.652 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-18T13:39:45.652 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T13:39:45.676 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-18T13:39:45.685 DEBUG:teuthology.orchestra.run.smithi178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:39:45.740 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = core 2024-09-18T13:39:45.753 DEBUG:teuthology.orchestra.run.smithi178:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:39:45.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:39:45.808 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-18T13:39:45.818 INFO:teuthology.task.internal:Transferring archived files... 2024-09-18T13:39:45.819 DEBUG:teuthology.misc:Transferring archived files from smithi178:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911397/remote/smithi178 2024-09-18T13:39:45.819 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T13:39:45.881 INFO:teuthology.task.internal:Removing archive directory... 2024-09-18T13:39:45.881 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T13:39:45.931 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-18T13:39:45.942 INFO:teuthology.task.internal:Not uploading archives. 2024-09-18T13:39:45.942 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-18T13:39:45.950 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-18T13:39:45.951 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T13:39:45.987 INFO:teuthology.orchestra.run.smithi178.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 13:39 /home/ubuntu/cephtest 2024-09-18T13:39:45.988 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-18T13:39:45.999 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-18T13:39:46.020 INFO:teuthology.run:Summary data: description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests} duration: 2914.2919166088104 flavor: crimson owner: scheduled_nmordech@teuthology success: true 2024-09-18T13:39:46.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T13:39:46.101 INFO:teuthology.run:pass