2024-09-22T03:38:18.599 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-22T03:38:18.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T03:38:18.728 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914377 branch: main description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests_old_format} email: ceph-qa@ceph.com first_in_suite: false job_id: '7914377' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-1 osd.1: crimson seastar cpu cores: 2-3 osd.2: crimson seastar cpu cores: 4-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_APP_NOT_ENABLED\) - is full \(reached quota - \(POOL_FULL\) sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: crimson sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 owner: scheduled_teuthology@teuthology priority: 101 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 2950 sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 sleep_before_teardown: 0 subset: 0/1 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_62da54b4b83a96ca9976b7e1d0c8272a564a2208/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 targets: smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKXTA6agvWHUWJQMZ9hZjwa9mtyy143k0pinAiiuWLoewVXIZNBvf3nbvKcmSo7f6TthjIVmMyANKNIF/rsbMjs= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rbd/crimson/test_crimson_librbd.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-21_20:56:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-22T03:38:18.728 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_62da54b4b83a96ca9976b7e1d0c8272a564a2208/qa; will attempt to use it 2024-09-22T03:38:18.729 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_62da54b4b83a96ca9976b7e1d0c8272a564a2208/qa/tasks 2024-09-22T03:38:18.729 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-22T03:38:18.730 INFO:teuthology.task.internal:Checking packages... 2024-09-22T03:38:18.750 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '62da54b4b83a96ca9976b7e1d0c8272a564a2208' 2024-09-22T03:38:18.750 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-22T03:38:18.750 INFO:teuthology.packaging:ref: None 2024-09-22T03:38:18.750 INFO:teuthology.packaging:tag: None 2024-09-22T03:38:18.750 INFO:teuthology.packaging:branch: main 2024-09-22T03:38:18.750 INFO:teuthology.packaging:sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-22T03:38:18.750 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=main 2024-09-22T03:38:18.973 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5092.g62da54b4 2024-09-22T03:38:18.974 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-22T03:38:18.982 INFO:teuthology.task.internal:no buildpackages task found 2024-09-22T03:38:18.983 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-22T03:38:18.988 INFO:teuthology.task.internal:Saving configuration 2024-09-22T03:38:19.001 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-22T03:38:19.015 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-22T03:38:19.040 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914377', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 03:33:24.422145', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKXTA6agvWHUWJQMZ9hZjwa9mtyy143k0pinAiiuWLoewVXIZNBvf3nbvKcmSo7f6TthjIVmMyANKNIF/rsbMjs='} 2024-09-22T03:38:19.040 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-22T03:38:19.058 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-09-22T03:38:19.059 INFO:teuthology.run_tasks:Running task console_log... 2024-09-22T03:38:19.113 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb4c5a80160>, signals=[15]) 2024-09-22T03:38:19.113 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-22T03:38:19.118 INFO:teuthology.task.internal:Opening connections... 2024-09-22T03:38:19.118 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-09-22T03:38:19.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:38:19.193 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-22T03:38:19.199 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-09-22T03:38:19.276 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-09-22T03:38:19.276 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-09-22T03:38:19.334 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-09-22T03:38:19.334 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="9" 2024-09-22T03:38:19.334 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-09-22T03:38:19.335 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-09-22T03:38:19.335 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="9" 2024-09-22T03:38:19.335 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el9" 2024-09-22T03:38:19.335 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T03:38:19.335 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-09-22T03:38:19.335 INFO:teuthology.orchestra.run.smithi138.stdout:LOGO="fedora-logo-icon" 2024-09-22T03:38:19.335 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T03:38:19.335 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-09-22T03:38:19.335 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T03:38:19.335 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T03:38:19.335 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T03:38:19.336 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-09-22T03:38:19.353 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-22T03:38:19.360 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-22T03:38:19.369 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-22T03:38:19.370 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-09-22T03:38:19.391 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-22T03:38:19.397 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-22T03:38:19.397 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-09-22T03:38:19.470 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-22T03:38:19.502 INFO:teuthology.run_tasks:Running task kernel... 2024-09-22T03:38:19.515 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-22T03:38:19.515 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-22T03:38:19.515 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T03:38:19.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T03:38:19.532 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-09-22T03:38:19.589 INFO:teuthology.orchestra.run.smithi138.stdout:5.14.0-503.el9.x86_64 2024-09-22T03:38:19.589 INFO:teuthology.task.kernel:Running kernel on smithi138: 5.14.0-503.el9.x86_64 2024-09-22T03:38:19.589 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum install -y kernel 2024-09-22T03:38:23.419 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.3 MB 00:02 2024-09-22T03:38:25.553 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-22T03:38:29.962 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-22T03:38:31.913 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-22T03:38:33.292 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-22T03:38:38.765 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-22T03:38:40.679 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T03:38:40.679 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T03:38:40.780 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:38:40.786 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:38:40.786 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-09-22T03:38:40.786 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:38:40.787 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:38:40.787 INFO:teuthology.orchestra.run.smithi138.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T03:38:40.787 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-22T03:38:40.787 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T03:38:40.787 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T03:38:40.787 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T03:38:40.787 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:38:40.787 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:38:40.787 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:38:40.787 INFO:teuthology.orchestra.run.smithi138.stdout:Install 4 Packages 2024-09-22T03:38:40.787 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:38:40.788 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 79 M 2024-09-22T03:38:40.788 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 126 M 2024-09-22T03:38:40.788 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:38:41.149 INFO:teuthology.orchestra.run.smithi138.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 417 kB/s | 36 kB 00:00 2024-09-22T03:38:45.191 INFO:teuthology.orchestra.run.smithi138.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-22T03:38:46.999 INFO:teuthology.orchestra.run.smithi138.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 4.9 MB/s | 29 MB 00:05 2024-09-22T03:38:47.683 INFO:teuthology.orchestra.run.smithi138.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 5.2 MB/s | 35 MB 00:06 2024-09-22T03:38:47.683 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:38:47.683 INFO:teuthology.orchestra.run.smithi138.stdout:Total 11 MB/s | 79 MB 00:06 2024-09-22T03:38:48.365 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:38:48.748 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:38:48.748 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:38:49.710 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:38:49.710 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:38:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:38:52.893 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T03:38:52.993 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T03:38:55.776 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T03:38:55.912 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T03:39:00.736 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T03:39:00.787 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:39:05.626 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:39:44.338 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:39:44.382 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:39:44.719 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:39:44.719 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T03:39:44.719 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T03:39:44.720 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T03:39:45.555 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:39:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:39:45.556 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:39:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T03:39:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T03:39:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T03:39:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T03:39:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:39:45.556 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:39:45.933 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T03:39:46.014 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T03:39:46.014 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T03:39:46.014 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T03:39:46.014 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T03:39:46.015 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T03:39:46.015 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-22T03:39:46.015 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T03:39:46.015 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T03:39:46.073 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T03:39:46.074 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T03:39:46.074 DEBUG:teuthology.orchestra.run.smithi138:> sudo rpm -qi grub2-tools 2024-09-22T03:39:46.105 INFO:teuthology.orchestra.run.smithi138.stdout:Name : grub2-tools 2024-09-22T03:39:46.105 INFO:teuthology.orchestra.run.smithi138.stdout:Epoch : 1 2024-09-22T03:39:46.105 INFO:teuthology.orchestra.run.smithi138.stdout:Version : 2.06 2024-09-22T03:39:46.105 INFO:teuthology.orchestra.run.smithi138.stdout:Release : 82.el9 2024-09-22T03:39:46.106 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: x86_64 2024-09-22T03:39:46.106 INFO:teuthology.orchestra.run.smithi138.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T03:39:46.106 INFO:teuthology.orchestra.run.smithi138.stdout:Group : Unspecified 2024-09-22T03:39:46.106 INFO:teuthology.orchestra.run.smithi138.stdout:Size : 8274670 2024-09-22T03:39:46.106 INFO:teuthology.orchestra.run.smithi138.stdout:License : GPLv3+ 2024-09-22T03:39:46.106 INFO:teuthology.orchestra.run.smithi138.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T03:39:46.106 INFO:teuthology.orchestra.run.smithi138.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T03:39:46.106 INFO:teuthology.orchestra.run.smithi138.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T03:39:46.106 INFO:teuthology.orchestra.run.smithi138.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T03:39:46.106 INFO:teuthology.orchestra.run.smithi138.stdout:Packager : builder@centos.org 2024-09-22T03:39:46.106 INFO:teuthology.orchestra.run.smithi138.stdout:Vendor : CentOS 2024-09-22T03:39:46.106 INFO:teuthology.orchestra.run.smithi138.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T03:39:46.106 INFO:teuthology.orchestra.run.smithi138.stdout:Summary : Support tools for GRUB. 2024-09-22T03:39:46.107 INFO:teuthology.orchestra.run.smithi138.stdout:Description : 2024-09-22T03:39:46.107 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:39:46.107 INFO:teuthology.orchestra.run.smithi138.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T03:39:46.107 INFO:teuthology.orchestra.run.smithi138.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T03:39:46.107 INFO:teuthology.orchestra.run.smithi138.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T03:39:46.107 INFO:teuthology.orchestra.run.smithi138.stdout:hardware devices. 2024-09-22T03:39:46.107 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:39:46.107 INFO:teuthology.orchestra.run.smithi138.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T03:39:46.108 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T03:39:46.108 INFO:teuthology.task.kernel:Updating grub on smithi138 to boot 5.14.0-508.el9.x86_64 2024-09-22T03:39:46.108 DEBUG:teuthology.orchestra.run.smithi138:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T03:39:46.764 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2024-09-22T03:39:48.047 INFO:teuthology.orchestra.run.smithi138.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T03:39:48.079 INFO:teuthology.orchestra.run.smithi138.stderr:done 2024-09-22T03:39:48.081 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-09-22T03:39:48.096 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.DWl7A7XvzF 2024-09-22T03:39:48.096 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DWl7A7XvzF 2024-09-22T03:39:48.162 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.DWl7A7XvzF 2024-09-22T03:39:48.300 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.DWl7A7XvzF is 6KB 2024-09-22T03:39:48.348 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.DWl7A7XvzF 2024-09-22T03:39:48.362 DEBUG:teuthology.orchestra.run.smithi138:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T03:39:48.434 INFO:teuthology.orchestra.run.smithi138.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T03:39:48.434 INFO:teuthology.orchestra.run.smithi138.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T03:39:48.434 INFO:teuthology.orchestra.run.smithi138.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T03:39:48.434 INFO:teuthology.orchestra.run.smithi138.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T03:39:48.436 DEBUG:teuthology.orchestra.run.smithi138:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T03:39:48.594 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now 2024-09-22T03:40:18.603 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-22T03:40:18.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-22T03:40:18.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:40:36.978 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-09-22T03:40:45.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-22T03:40:45.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:40:49.042 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-09-22T03:41:01.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-22T03:41:01.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:41:32.890 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-09-22T03:41:33.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-22T03:41:33.218 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-22T03:41:33.218 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-09-22T03:41:33.232 INFO:teuthology.orchestra.run.smithi138.stdout:5.14.0-508.el9.x86_64 2024-09-22T03:41:33.232 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T03:41:33.232 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T03:41:33.233 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T03:41:34.234 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-22T03:41:34.234 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T03:41:34.354 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1 2024-09-22T03:41:34.384 DEBUG:teuthology.parallel:result is None 2024-09-22T03:41:34.385 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-22T03:41:34.392 INFO:teuthology.task.internal:Creating test directory... 2024-09-22T03:41:34.392 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T03:41:34.406 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-22T03:41:34.413 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-22T03:41:34.424 INFO:teuthology.task.internal:Creating archive directory... 2024-09-22T03:41:34.424 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T03:41:34.474 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-22T03:41:34.480 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-22T03:41:34.481 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T03:41:34.539 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T03:41:34.549 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T03:41:34.551 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-22T03:41:34.557 INFO:teuthology.task.internal:Configuring sudo... 2024-09-22T03:41:34.558 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T03:41:34.618 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-22T03:41:34.627 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-22T03:41:34.628 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T03:41:34.678 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T03:41:34.762 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T03:41:34.809 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T03:41:34.893 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T03:41:34.936 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:41:34.936 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T03:41:35.008 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-09-22T03:41:35.100 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T03:41:35.518 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-22T03:41:35.527 INFO:teuthology.task.internal:Starting timer... 2024-09-22T03:41:35.527 INFO:teuthology.run_tasks:Running task pcp... 2024-09-22T03:41:35.569 INFO:teuthology.run_tasks:Running task selinux... 2024-09-22T03:41:35.578 DEBUG:teuthology.orchestra.run.smithi138:> sudo service auditd rotate 2024-09-22T03:41:35.690 INFO:teuthology.orchestra.run.smithi138.stdout:Rotating logs: 2024-09-22T03:41:35.693 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-22T03:41:35.693 DEBUG:teuthology.orchestra.run.smithi138:> /usr/sbin/getenforce 2024-09-22T03:41:35.752 INFO:teuthology.orchestra.run.smithi138.stdout:Permissive 2024-09-22T03:41:35.752 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi138.front.sepia.ceph.com': 'permissive'} 2024-09-22T03:41:35.752 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T03:41:35.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T03:41:35.824 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-22T03:41:35.824 DEBUG:teuthology.orchestra.run.smithi138:> sudo /usr/sbin/setenforce permissive 2024-09-22T03:41:36.053 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-22T03:41:36.062 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-22T03:41:36.072 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-22T03:41:36.072 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-22T03:45:19.661 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi138.front.sepia.ceph.com')] 2024-09-22T03:45:19.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-22T03:45:19.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:45:19.737 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-09-22T03:45:19.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-22T03:45:19.814 INFO:teuthology.run_tasks:Running task clock... 2024-09-22T03:45:19.824 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-22T03:45:19.824 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T03:45:19.824 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T03:45:19.882 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T03:45:19.897 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T03:45:19.921 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: ntpd: command not found 2024-09-22T03:45:19.933 INFO:teuthology.orchestra.run.smithi138.stdout:506 Cannot talk to daemon 2024-09-22T03:45:19.947 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T03:45:19.961 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T03:45:20.017 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-09-22T03:45:20.021 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T03:45:20.021 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-09-22T03:45:20.021 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:45:20.022 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:45:20.022 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:45:20.022 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:45:20.022 INFO:teuthology.run_tasks:Running task install... 2024-09-22T03:45:20.030 DEBUG:teuthology.task.install:project ceph 2024-09-22T03:45:20.031 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'}} 2024-09-22T03:45:20.031 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'} 2024-09-22T03:45:20.031 INFO:teuthology.task.install:Using flavor: crimson 2024-09-22T03:45:20.036 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-22T03:45:20.036 INFO:teuthology.task.install:extra packages: [] 2024-09-22T03:45:20.036 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208', 'tag': None, 'wait_for_package': False} 2024-09-22T03:45:20.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-22T03:45:20.187 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/ 2024-09-22T03:45:20.187 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5092.g62da54b4 2024-09-22T03:45:20.294 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T03:45:20.294 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:45:20.294 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T03:45:20.320 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-22T03:45:20.320 DEBUG:teuthology.orchestra.run.smithi138:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/62da54b4b83a96ca9976b7e1d0c8272a564a2208/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T03:45:20.386 DEBUG:teuthology.orchestra.run.smithi138:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T03:45:20.461 DEBUG:teuthology.orchestra.run.smithi138:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T03:45:20.526 INFO:teuthology.orchestra.run.smithi138.stdout:check_obsoletes = 1 2024-09-22T03:45:20.527 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum clean all 2024-09-22T03:45:20.750 INFO:teuthology.orchestra.run.smithi138.stdout:45 files removed 2024-09-22T03:45:20.778 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-radosgw 2024-09-22T03:45:21.344 INFO:teuthology.orchestra.run.smithi138.stdout:ceph packages for x86_64 316 kB/s | 88 kB 00:00 2024-09-22T03:45:21.636 INFO:teuthology.orchestra.run.smithi138.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-22T03:45:21.903 INFO:teuthology.orchestra.run.smithi138.stdout:ceph source packages 9.0 kB/s | 2.1 kB 00:00 2024-09-22T03:45:22.588 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-22T03:45:24.531 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-22T03:45:29.557 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - CRB 5.3 MB/s | 6.5 MB 00:01 2024-09-22T03:45:31.358 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-22T03:45:32.712 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-22T03:45:38.160 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-22T03:45:40.386 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:45:40.395 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:45:40.395 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-22T03:45:40.395 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:45:40.395 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:45:40.395 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 10 M 2024-09-22T03:45:40.395 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrading: 2024-09-22T03:45:40.395 INFO:teuthology.orchestra.run.smithi138.stdout: librados2 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 3.5 M 2024-09-22T03:45:40.395 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 3.8 M 2024-09-22T03:45:40.395 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-22T03:45:40.395 INFO:teuthology.orchestra.run.smithi138.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T03:45:40.395 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 6.1 M 2024-09-22T03:45:40.396 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 20 M 2024-09-22T03:45:40.396 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 25 k 2024-09-22T03:45:40.396 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T03:45:40.396 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T03:45:40.396 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T03:45:40.396 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 808 k 2024-09-22T03:45:40.396 INFO:teuthology.orchestra.run.smithi138.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-22T03:45:40.396 INFO:teuthology.orchestra.run.smithi138.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T03:45:40.396 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T03:45:40.396 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T03:45:40.396 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 558 k 2024-09-22T03:45:40.396 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T03:45:40.396 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 5.4 M 2024-09-22T03:45:40.396 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T03:45:40.397 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T03:45:40.397 INFO:teuthology.orchestra.run.smithi138.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T03:45:40.397 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 45 k 2024-09-22T03:45:40.397 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 148 k 2024-09-22T03:45:40.397 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 159 k 2024-09-22T03:45:40.397 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T03:45:40.397 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 314 k 2024-09-22T03:45:40.397 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 302 k 2024-09-22T03:45:40.397 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 99 k 2024-09-22T03:45:40.397 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T03:45:40.397 INFO:teuthology.orchestra.run.smithi138.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T03:45:40.397 INFO:teuthology.orchestra.run.smithi138.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T03:45:40.397 INFO:teuthology.orchestra.run.smithi138.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T03:45:40.397 INFO:teuthology.orchestra.run.smithi138.stdout:Installing weak dependencies: 2024-09-22T03:45:40.398 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T03:45:40.398 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:45:40.398 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:45:40.398 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:45:40.398 INFO:teuthology.orchestra.run.smithi138.stdout:Install 31 Packages 2024-09-22T03:45:40.398 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrade 2 Packages 2024-09-22T03:45:40.398 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:45:40.398 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 60 M 2024-09-22T03:45:40.398 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:45:41.337 INFO:teuthology.orchestra.run.smithi138.stdout:(1/33): ceph-base-19.3.0-5092.g62da54b4.el9.x86 12 MB/s | 6.1 MB 00:00 2024-09-22T03:45:41.387 INFO:teuthology.orchestra.run.smithi138.stdout:(2/33): ceph-selinux-19.3.0-5092.g62da54b4.el9. 504 kB/s | 25 kB 00:00 2024-09-22T03:45:41.488 INFO:teuthology.orchestra.run.smithi138.stdout:(3/33): libcephfs2-19.3.0-5092.g62da54b4.el9.x8 7.9 MB/s | 808 kB 00:00 2024-09-22T03:45:41.588 INFO:teuthology.orchestra.run.smithi138.stdout:(4/33): libradosstriper1-19.3.0-5092.g62da54b4. 5.5 MB/s | 558 kB 00:00 2024-09-22T03:45:41.838 INFO:teuthology.orchestra.run.smithi138.stdout:(5/33): ceph-radosgw-19.3.0-5092.g62da54b4.el9. 10 MB/s | 10 MB 00:01 2024-09-22T03:45:42.039 INFO:teuthology.orchestra.run.smithi138.stdout:(6/33): ceph-common-19.3.0-5092.g62da54b4.el9.x 16 MB/s | 20 MB 00:01 2024-09-22T03:45:42.064 INFO:teuthology.orchestra.run.smithi138.stdout:(7/33): python3-ceph-argparse-19.3.0-5092.g62da 200 kB/s | 45 kB 00:00 2024-09-22T03:45:42.089 INFO:teuthology.orchestra.run.smithi138.stdout:(8/33): python3-ceph-common-19.3.0-5092.g62da54 2.9 MB/s | 148 kB 00:00 2024-09-22T03:45:42.114 INFO:teuthology.orchestra.run.smithi138.stdout:(9/33): python3-cephfs-19.3.0-5092.g62da54b4.el 3.1 MB/s | 159 kB 00:00 2024-09-22T03:45:42.140 INFO:teuthology.orchestra.run.smithi138.stdout:(10/33): python3-rados-19.3.0-5092.g62da54b4.el 6.1 MB/s | 314 kB 00:00 2024-09-22T03:45:42.174 INFO:teuthology.orchestra.run.smithi138.stdout:(11/33): python3-rbd-19.3.0-5092.g62da54b4.el9. 5.0 MB/s | 302 kB 00:00 2024-09-22T03:45:42.199 INFO:teuthology.orchestra.run.smithi138.stdout:(12/33): python3-rgw-19.3.0-5092.g62da54b4.el9. 1.7 MB/s | 99 kB 00:00 2024-09-22T03:45:42.283 INFO:teuthology.orchestra.run.smithi138.stdout:(13/33): librgw2-19.3.0-5092.g62da54b4.el9.x86_ 7.7 MB/s | 5.4 MB 00:00 2024-09-22T03:45:42.341 INFO:teuthology.orchestra.run.smithi138.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 639 kB/s | 107 kB 00:00 2024-09-22T03:45:42.392 INFO:teuthology.orchestra.run.smithi138.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-22T03:45:42.426 INFO:teuthology.orchestra.run.smithi138.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 753 kB/s | 171 kB 00:00 2024-09-22T03:45:42.451 INFO:teuthology.orchestra.run.smithi138.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 954 kB/s | 160 kB 00:00 2024-09-22T03:45:42.493 INFO:teuthology.orchestra.run.smithi138.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-22T03:45:42.518 INFO:teuthology.orchestra.run.smithi138.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 631 kB/s | 42 kB 00:00 2024-09-22T03:45:42.544 INFO:teuthology.orchestra.run.smithi138.stdout:(20/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-22T03:45:42.561 INFO:teuthology.orchestra.run.smithi138.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 853 kB/s | 36 kB 00:00 2024-09-22T03:45:42.586 INFO:teuthology.orchestra.run.smithi138.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-22T03:45:42.603 INFO:teuthology.orchestra.run.smithi138.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 801 kB/s | 47 kB 00:00 2024-09-22T03:45:42.662 INFO:teuthology.orchestra.run.smithi138.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.0 MB/s | 308 kB 00:00 2024-09-22T03:45:42.687 INFO:teuthology.orchestra.run.smithi138.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-22T03:45:42.704 INFO:teuthology.orchestra.run.smithi138.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 304 kB/s | 26 kB 00:00 2024-09-22T03:45:42.729 INFO:teuthology.orchestra.run.smithi138.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-22T03:45:42.763 INFO:teuthology.orchestra.run.smithi138.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-22T03:45:42.847 INFO:teuthology.orchestra.run.smithi138.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.7 MB/s | 839 kB 00:00 2024-09-22T03:45:42.922 INFO:teuthology.orchestra.run.smithi138.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-22T03:45:43.065 INFO:teuthology.orchestra.run.smithi138.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 9.2 MB/s | 4.4 MB 00:00 2024-09-22T03:45:43.140 INFO:teuthology.orchestra.run.smithi138.stdout:(32/33): librados2-19.3.0-5092.g62da54b4.el9.x8 12 MB/s | 3.5 MB 00:00 2024-09-22T03:45:43.281 INFO:teuthology.orchestra.run.smithi138.stdout:(33/33): librbd1-19.3.0-5092.g62da54b4.el9.x86_ 11 MB/s | 3.8 MB 00:00 2024-09-22T03:45:43.287 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:45:43.287 INFO:teuthology.orchestra.run.smithi138.stdout:Total 21 MB/s | 60 MB 00:02 2024-09-22T03:45:43.407 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:45:43.445 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:45:43.445 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:45:44.135 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:45:44.136 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:45:45.643 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:45:46.171 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-22T03:45:46.226 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 2/35 2024-09-22T03:45:46.318 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 2/35 2024-09-22T03:45:46.407 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 3/35 2024-09-22T03:45:46.436 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 4/35 2024-09-22T03:45:46.499 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 4/35 2024-09-22T03:45:46.545 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-22T03:45:46.575 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-22T03:45:46.600 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-22T03:45:46.623 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-22T03:45:46.653 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-22T03:45:46.850 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-22T03:45:46.882 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-22T03:45:46.917 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-22T03:45:46.960 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-argparse-2:19.3.0-5092.g62da54b4.el9. 11/35 2024-09-22T03:45:46.989 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 12/35 2024-09-22T03:45:47.080 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-22T03:45:47.112 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_6 14/35 2024-09-22T03:45:47.201 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_6 14/35 2024-09-22T03:45:47.245 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-22T03:45:47.385 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-22T03:45:47.430 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-22T03:45:47.488 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-22T03:45:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-22T03:45:47.567 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-22T03:45:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-22T03:45:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-22T03:45:48.037 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 23/35 2024-09-22T03:45:48.129 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 23/35 2024-09-22T03:45:48.159 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 24/35 2024-09-22T03:45:48.196 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-22T03:45:48.784 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-22T03:45:48.807 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 27/35 2024-09-22T03:45:48.887 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 27/35 2024-09-22T03:45:48.970 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 28/35 2024-09-22T03:45:49.002 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-common-2:19.3.0-5092.g62da54b4.el9.x8 29/35 2024-09-22T03:45:51.414 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 30/35 2024-09-22T03:45:51.466 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 30/35 2024-09-22T03:45:52.188 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 30/35 2024-09-22T03:45:52.238 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 31/35 2024-09-22T03:45:52.313 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 31/35 2024-09-22T03:45:52.313 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T03:45:52.314 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T03:45:52.314 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:45:52.356 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 32/35 2024-09-22T03:46:03.069 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 32/35 2024-09-22T03:46:03.069 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /sys 2024-09-22T03:46:03.069 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /proc 2024-09-22T03:46:03.069 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /mnt 2024-09-22T03:46:03.069 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /var/tmp 2024-09-22T03:46:03.069 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /home 2024-09-22T03:46:03.069 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /root 2024-09-22T03:46:03.069 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /tmp 2024-09-22T03:46:03.069 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:04.208 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 33/35 2024-09-22T03:46:04.235 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 33/35 2024-09-22T03:46:04.235 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:46:04.235 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T03:46:04.235 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T03:46:04.235 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T03:46:04.235 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:04.237 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-22T03:46:04.328 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-22T03:46:04.328 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T03:46:05.693 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T03:46:05.693 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 1/35 2024-09-22T03:46:05.693 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 2/35 2024-09-22T03:46:05.693 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 3/35 2024-09-22T03:46:05.693 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 4/35 2024-09-22T03:46:05.693 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 5/35 2024-09-22T03:46:05.693 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_6 6/35 2024-09-22T03:46:05.693 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 7/35 2024-09-22T03:46:05.693 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5092.g62da54b4.el9. 8/35 2024-09-22T03:46:05.693 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-common-2:19.3.0-5092.g62da54b4.el9.x8 9/35 2024-09-22T03:46:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 10/35 2024-09-22T03:46:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 11/35 2024-09-22T03:46:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 12/35 2024-09-22T03:46:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 13/35 2024-09-22T03:46:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-22T03:46:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-22T03:46:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-22T03:46:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-22T03:46:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-22T03:46:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-22T03:46:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-22T03:46:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-22T03:46:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-22T03:46:05.695 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-22T03:46:05.695 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-22T03:46:05.695 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-22T03:46:05.695 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-22T03:46:05.695 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-22T03:46:05.696 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-22T03:46:05.696 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-22T03:46:05.696 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-22T03:46:05.696 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-22T03:46:05.696 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 32/35 2024-09-22T03:46:05.696 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-22T03:46:05.696 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 34/35 2024-09-22T03:46:06.605 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T03:46:06.605 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:06.605 INFO:teuthology.orchestra.run.smithi138.stdout:Upgraded: 2024-09-22T03:46:06.605 INFO:teuthology.orchestra.run.smithi138.stdout: librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:06.605 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:06.605 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:46:06.605 INFO:teuthology.orchestra.run.smithi138.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T03:46:06.605 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:06.606 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:06.606 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:06.606 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:06.606 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T03:46:06.606 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T03:46:06.606 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T03:46:06.606 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:06.606 INFO:teuthology.orchestra.run.smithi138.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-22T03:46:06.606 INFO:teuthology.orchestra.run.smithi138.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T03:46:06.606 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T03:46:06.606 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T03:46:06.606 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:06.606 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T03:46:06.607 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:06.607 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T03:46:06.607 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T03:46:06.607 INFO:teuthology.orchestra.run.smithi138.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T03:46:06.607 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:06.607 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:06.607 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:06.607 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T03:46:06.607 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:06.607 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:06.607 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:06.607 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T03:46:06.607 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T03:46:06.607 INFO:teuthology.orchestra.run.smithi138.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T03:46:06.608 INFO:teuthology.orchestra.run.smithi138.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T03:46:06.608 INFO:teuthology.orchestra.run.smithi138.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T03:46:06.608 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:06.608 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:46:06.951 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-test 2024-09-22T03:46:07.535 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:29 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:46:07.673 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:46:07.674 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:46:07.674 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-22T03:46:07.674 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:46:07.675 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:46:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 81 M 2024-09-22T03:46:07.675 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-22T03:46:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-22T03:46:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 175 k 2024-09-22T03:46:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-22T03:46:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-22T03:46:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T03:46:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T03:46:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T03:46:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-22T03:46:07.675 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:07.675 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:46:07.675 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:46:07.675 INFO:teuthology.orchestra.run.smithi138.stdout:Install 9 Packages 2024-09-22T03:46:07.676 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:07.676 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 83 M 2024-09-22T03:46:07.676 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 775 M 2024-09-22T03:46:07.676 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:46:08.204 INFO:teuthology.orchestra.run.smithi138.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 650 kB/s | 94 kB 00:00 2024-09-22T03:46:08.288 INFO:teuthology.orchestra.run.smithi138.stdout:(2/9): libcephsqlite-19.3.0-5092.g62da54b4.el9. 766 kB/s | 175 kB 00:00 2024-09-22T03:46:08.380 INFO:teuthology.orchestra.run.smithi138.stdout:(3/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 2.9 MB/s | 513 kB 00:00 2024-09-22T03:46:08.430 INFO:teuthology.orchestra.run.smithi138.stdout:(4/9): libubsan-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 183 kB 00:00 2024-09-22T03:46:08.522 INFO:teuthology.orchestra.run.smithi138.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-22T03:46:08.564 INFO:teuthology.orchestra.run.smithi138.stdout:(6/9): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-09-22T03:46:08.598 INFO:teuthology.orchestra.run.smithi138.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 844 kB/s | 64 kB 00:00 2024-09-22T03:46:08.623 INFO:teuthology.orchestra.run.smithi138.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.0 MB/s | 122 kB 00:00 2024-09-22T03:46:10.574 INFO:teuthology.orchestra.run.smithi138.stdout:(9/9): ceph-test-19.3.0-5092.g62da54b4.el9.x86_ 32 MB/s | 81 MB 00:02 2024-09-22T03:46:10.637 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:46:10.638 INFO:teuthology.orchestra.run.smithi138.stdout:Total 29 MB/s | 83 MB 00:02 2024-09-22T03:46:10.662 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:46:10.684 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:46:10.684 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:46:11.278 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:46:11.279 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:46:12.142 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:46:12.206 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-22T03:46:12.257 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-22T03:46:12.312 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-22T03:46:12.347 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-22T03:46:12.378 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-22T03:46:12.403 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-22T03:46:12.456 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-22T03:46:12.496 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-22T03:46:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 8/9 2024-09-22T03:46:23.373 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 8/9 2024-09-22T03:46:23.464 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 9/9 2024-09-22T03:46:29.723 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 9/9 2024-09-22T03:46:29.723 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 1/9 2024-09-22T03:46:29.723 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 2/9 2024-09-22T03:46:29.723 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-22T03:46:29.723 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-22T03:46:29.723 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-22T03:46:29.723 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-22T03:46:29.724 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-22T03:46:29.724 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-22T03:46:30.109 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-22T03:46:30.109 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:30.109 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:46:30.109 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:30.109 INFO:teuthology.orchestra.run.smithi138.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-22T03:46:30.109 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:30.109 INFO:teuthology.orchestra.run.smithi138.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-22T03:46:30.109 INFO:teuthology.orchestra.run.smithi138.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-22T03:46:30.109 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T03:46:30.109 INFO:teuthology.orchestra.run.smithi138.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T03:46:30.109 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T03:46:30.110 INFO:teuthology.orchestra.run.smithi138.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-22T03:46:30.110 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:30.110 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:46:30.437 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph 2024-09-22T03:46:31.025 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:53 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:46:31.165 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:46:31.167 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:46:31.167 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-22T03:46:31.167 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:46:31.167 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:46:31.167 INFO:teuthology.orchestra.run.smithi138.stdout: ceph x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 6.5 k 2024-09-22T03:46:31.167 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-22T03:46:31.167 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 2.2 M 2024-09-22T03:46:31.167 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 1.6 M 2024-09-22T03:46:31.167 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 292 k 2024-09-22T03:46:31.167 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 5.1 M 2024-09-22T03:46:31.168 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 70 M 2024-09-22T03:46:31.168 INFO:teuthology.orchestra.run.smithi138.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T03:46:31.168 INFO:teuthology.orchestra.run.smithi138.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T03:46:31.168 INFO:teuthology.orchestra.run.smithi138.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T03:46:31.168 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T03:46:31.168 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T03:46:31.168 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T03:46:31.168 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T03:46:31.168 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T03:46:31.168 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T03:46:31.168 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T03:46:31.168 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections 2024-09-22T03:46:31.168 INFO:teuthology.orchestra.run.smithi138.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-22T03:46:31.169 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T03:46:31.169 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T03:46:31.169 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T03:46:31.169 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T03:46:31.169 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T03:46:31.169 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T03:46:31.169 INFO:teuthology.orchestra.run.smithi138.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T03:46:31.169 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T03:46:31.169 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T03:46:31.169 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T03:46:31.169 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T03:46:31.169 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T03:46:31.169 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T03:46:31.169 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T03:46:31.169 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T03:46:31.170 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T03:46:31.170 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T03:46:31.170 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T03:46:31.170 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T03:46:31.170 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T03:46:31.170 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:31.170 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:46:31.170 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:46:31.171 INFO:teuthology.orchestra.run.smithi138.stdout:Install 37 Packages 2024-09-22T03:46:31.171 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:31.171 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 84 M 2024-09-22T03:46:31.171 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 896 M 2024-09-22T03:46:31.171 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:46:31.488 INFO:teuthology.orchestra.run.smithi138.stdout:(1/37): ceph-19.3.0-5092.g62da54b4.el9.x86_64.r 54 kB/s | 6.5 kB 00:00 2024-09-22T03:46:31.681 INFO:teuthology.orchestra.run.smithi138.stdout:(2/37): ceph-mgr-19.3.0-5092.g62da54b4.el9.x86_ 5.1 MB/s | 1.6 MB 00:00 2024-09-22T03:46:31.731 INFO:teuthology.orchestra.run.smithi138.stdout:(3/37): ceph-mds-19.3.0-5092.g62da54b4.el9.x86_ 6.0 MB/s | 2.2 MB 00:00 2024-09-22T03:46:31.823 INFO:teuthology.orchestra.run.smithi138.stdout:(4/37): ceph-mgr-modules-core-19.3.0-5092.g62da 3.1 MB/s | 292 kB 00:00 2024-09-22T03:46:31.898 INFO:teuthology.orchestra.run.smithi138.stdout:(5/37): ceph-mon-19.3.0-5092.g62da54b4.el9.x86_ 12 MB/s | 5.1 MB 00:00 2024-09-22T03:46:32.232 INFO:teuthology.orchestra.run.smithi138.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 619 kB/s | 253 kB 00:00 2024-09-22T03:46:32.341 INFO:teuthology.orchestra.run.smithi138.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 984 kB/s | 106 kB 00:00 2024-09-22T03:46:32.433 INFO:teuthology.orchestra.run.smithi138.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.4 MB/s | 135 kB 00:00 2024-09-22T03:46:32.492 INFO:teuthology.orchestra.run.smithi138.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-09-22T03:46:32.601 INFO:teuthology.orchestra.run.smithi138.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.9 MB/s | 215 kB 00:00 2024-09-22T03:46:32.651 INFO:teuthology.orchestra.run.smithi138.stdout:(11/37): python3-cryptography-36.0.1-4.el9.x86_ 1.6 MB/s | 1.2 MB 00:00 2024-09-22T03:46:32.793 INFO:teuthology.orchestra.run.smithi138.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 982 kB/s | 188 kB 00:00 2024-09-22T03:46:32.827 INFO:teuthology.orchestra.run.smithi138.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 982 kB/s | 172 kB 00:00 2024-09-22T03:46:32.852 INFO:teuthology.orchestra.run.smithi138.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 592 kB/s | 35 kB 00:00 2024-09-22T03:46:32.877 INFO:teuthology.orchestra.run.smithi138.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-22T03:46:32.903 INFO:teuthology.orchestra.run.smithi138.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-22T03:46:32.928 INFO:teuthology.orchestra.run.smithi138.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 828 kB/s | 42 kB 00:00 2024-09-22T03:46:32.953 INFO:teuthology.orchestra.run.smithi138.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 441 kB/s | 22 kB 00:00 2024-09-22T03:46:32.995 INFO:teuthology.orchestra.run.smithi138.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-22T03:46:33.037 INFO:teuthology.orchestra.run.smithi138.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 4.2 MB/s | 172 kB 00:00 2024-09-22T03:46:33.063 INFO:teuthology.orchestra.run.smithi138.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 399 kB/s | 43 kB 00:00 2024-09-22T03:46:33.088 INFO:teuthology.orchestra.run.smithi138.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 426 kB/s | 11 kB 00:00 2024-09-22T03:46:33.113 INFO:teuthology.orchestra.run.smithi138.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 705 kB/s | 18 kB 00:00 2024-09-22T03:46:33.139 INFO:teuthology.orchestra.run.smithi138.stdout:(24/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.5 MB/s | 358 kB 00:00 2024-09-22T03:46:33.164 INFO:teuthology.orchestra.run.smithi138.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 458 kB/s | 23 kB 00:00 2024-09-22T03:46:33.181 INFO:teuthology.orchestra.run.smithi138.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 462 kB/s | 19 kB 00:00 2024-09-22T03:46:33.207 INFO:teuthology.orchestra.run.smithi138.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 468 kB/s | 20 kB 00:00 2024-09-22T03:46:33.241 INFO:teuthology.orchestra.run.smithi138.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 783 kB/s | 46 kB 00:00 2024-09-22T03:46:33.266 INFO:teuthology.orchestra.run.smithi138.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-09-22T03:46:33.291 INFO:teuthology.orchestra.run.smithi138.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 659 kB/s | 16 kB 00:00 2024-09-22T03:46:33.316 INFO:teuthology.orchestra.run.smithi138.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-22T03:46:33.342 INFO:teuthology.orchestra.run.smithi138.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-22T03:46:33.367 INFO:teuthology.orchestra.run.smithi138.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 707 kB/s | 36 kB 00:00 2024-09-22T03:46:33.393 INFO:teuthology.orchestra.run.smithi138.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-22T03:46:33.410 INFO:teuthology.orchestra.run.smithi138.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-22T03:46:33.443 INFO:teuthology.orchestra.run.smithi138.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-22T03:46:34.311 INFO:teuthology.orchestra.run.smithi138.stdout:(37/37): ceph-osd-19.3.0-5092.g62da54b4.el9.x86 27 MB/s | 70 MB 00:02 2024-09-22T03:46:34.314 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:46:34.314 INFO:teuthology.orchestra.run.smithi138.stdout:Total 27 MB/s | 84 MB 00:03 2024-09-22T03:46:34.470 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:46:34.511 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:46:34.511 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:46:35.304 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:46:35.304 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:46:36.997 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:46:37.055 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-22T03:46:37.087 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-22T03:46:37.115 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-22T03:46:37.188 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-22T03:46:37.231 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-22T03:46:37.265 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-22T03:46:37.358 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-22T03:46:37.450 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-22T03:46:37.490 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-22T03:46:37.526 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-22T03:46:37.556 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-22T03:46:37.590 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-22T03:46:37.624 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-22T03:46:37.673 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-22T03:46:37.716 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-22T03:46:37.751 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-22T03:46:37.800 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-22T03:46:37.831 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-22T03:46:37.905 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-22T03:46:38.045 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-22T03:46:38.125 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-22T03:46:38.177 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-22T03:46:38.224 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-22T03:46:38.273 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-22T03:46:38.338 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-22T03:46:38.524 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-22T03:46:38.579 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-22T03:46:38.657 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-22T03:46:38.746 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-22T03:46:38.791 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-22T03:46:38.923 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-22T03:46:39.117 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5092.g62da54b4.el9. 32/37 2024-09-22T03:46:39.140 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 33/37 2024-09-22T03:46:39.166 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 33/37 2024-09-22T03:46:39.166 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:46:39.166 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T03:46:39.166 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T03:46:39.166 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T03:46:39.166 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:49.724 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 34/37 2024-09-22T03:46:49.751 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 34/37 2024-09-22T03:46:49.752 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:46:49.752 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T03:46:49.752 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T03:46:49.752 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T03:46:49.752 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:50.317 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 35/37 2024-09-22T03:46:50.343 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 35/37 2024-09-22T03:46:50.343 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:46:50.343 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T03:46:50.343 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T03:46:50.343 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T03:46:50.343 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:50.593 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 36/37 2024-09-22T03:46:50.617 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 36/37 2024-09-22T03:46:50.618 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:46:50.618 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T03:46:50.618 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T03:46:50.618 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T03:46:50.618 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:50.692 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 37/37 2024-09-22T03:46:57.905 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 37/37 2024-09-22T03:46:57.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 1/37 2024-09-22T03:46:57.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 2/37 2024-09-22T03:46:57.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 3/37 2024-09-22T03:46:57.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 4/37 2024-09-22T03:46:57.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 5/37 2024-09-22T03:46:57.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5092.g62da54b4.el9. 6/37 2024-09-22T03:46:57.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-22T03:46:57.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-22T03:46:57.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-22T03:46:57.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-22T03:46:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-22T03:46:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-22T03:46:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-22T03:46:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-22T03:46:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-22T03:46:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-22T03:46:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-22T03:46:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-22T03:46:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-22T03:46:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-22T03:46:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-22T03:46:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-22T03:46:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-22T03:46:57.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-22T03:46:57.907 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-22T03:46:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-22T03:46:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-22T03:46:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-22T03:46:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-22T03:46:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-22T03:46:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-22T03:46:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-22T03:46:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-22T03:46:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-22T03:46:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-22T03:46:57.908 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-22T03:46:59.032 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-22T03:46:59.032 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:59.032 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:46:59.032 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:59.033 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:59.033 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:59.033 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:46:59.033 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:59.033 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:59.033 INFO:teuthology.orchestra.run.smithi138.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T03:46:59.033 INFO:teuthology.orchestra.run.smithi138.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T03:46:59.033 INFO:teuthology.orchestra.run.smithi138.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T03:46:59.033 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T03:46:59.033 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T03:46:59.033 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T03:46:59.033 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T03:46:59.033 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T03:46:59.033 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T03:46:59.033 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T03:46:59.034 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T03:46:59.034 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T03:46:59.034 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T03:46:59.034 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T03:46:59.034 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T03:46:59.034 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T03:46:59.034 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T03:46:59.034 INFO:teuthology.orchestra.run.smithi138.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T03:46:59.034 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T03:46:59.034 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T03:46:59.034 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T03:46:59.034 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T03:46:59.034 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T03:46:59.034 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T03:46:59.035 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T03:46:59.035 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T03:46:59.035 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T03:46:59.035 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T03:46:59.035 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T03:46:59.035 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T03:46:59.035 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T03:46:59.035 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:46:59.035 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:46:59.313 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-base 2024-09-22T03:46:59.890 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:21 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:46:59.979 INFO:teuthology.orchestra.run.smithi138.stdout:Package ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:47:00.021 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:00.022 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-22T03:47:00.022 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:00.091 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install cephadm 2024-09-22T03:47:00.672 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:22 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:00.802 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:00.803 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:00.803 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-22T03:47:00.803 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:00.803 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:47:00.803 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 784 k 2024-09-22T03:47:00.803 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:00.803 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:47:00.803 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:00.803 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-22T03:47:00.803 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:00.803 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 784 k 2024-09-22T03:47:00.803 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 791 k 2024-09-22T03:47:00.803 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:47:01.196 INFO:teuthology.orchestra.run.smithi138.stdout:cephadm-19.3.0-5092.g62da54b4.el9.noarch.rpm 2.0 MB/s | 784 kB 00:00 2024-09-22T03:47:01.197 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:01.198 INFO:teuthology.orchestra.run.smithi138.stdout:Total 1.9 MB/s | 784 kB 00:00 2024-09-22T03:47:01.198 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:47:01.203 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:47:01.203 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:47:01.209 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:47:01.209 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:47:01.281 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:47:01.753 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:47:01.852 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:47:02.231 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:47:02.480 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:47:02.480 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:02.480 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:47:02.480 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:02.480 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:02.480 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:02.709 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-immutable-object-cache 2024-09-22T03:47:03.303 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:25 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:03.438 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:03.438 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:03.438 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-09-22T03:47:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:47:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 158 k 2024-09-22T03:47:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:47:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-22T03:47:03.439 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 158 k 2024-09-22T03:47:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 644 k 2024-09-22T03:47:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:47:03.657 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-immutable-object-cache-19.3.0-5092.g62da54 729 kB/s | 158 kB 00:00 2024-09-22T03:47:03.657 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:03.657 INFO:teuthology.orchestra.run.smithi138.stdout:Total 723 kB/s | 158 kB 00:00 2024-09-22T03:47:03.657 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:47:03.667 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:47:03.667 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:47:03.724 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:47:03.724 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:47:03.877 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:47:03.982 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4. 1/1 2024-09-22T03:47:04.007 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4. 1/1 2024-09-22T03:47:04.007 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:47:04.007 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T03:47:04.008 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:04.921 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4. 1/1 2024-09-22T03:47:04.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:04.922 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:47:04.922 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:04.922 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:04.922 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:05.135 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr 2024-09-22T03:47:05.731 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:27 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:05.821 INFO:teuthology.orchestra.run.smithi138.stdout:Package ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:47:05.864 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:05.865 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-22T03:47:05.865 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:05.949 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-dashboard 2024-09-22T03:47:06.529 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:28 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:06.664 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:06.665 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:06.665 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-22T03:47:06.665 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:06.665 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:47:06.665 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 14 M 2024-09-22T03:47:06.665 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-22T03:47:06.665 INFO:teuthology.orchestra.run.smithi138.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T03:47:06.665 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 34 k 2024-09-22T03:47:06.665 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 16 k 2024-09-22T03:47:06.665 INFO:teuthology.orchestra.run.smithi138.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T03:47:06.665 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T03:47:06.665 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T03:47:06.666 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T03:47:06.666 INFO:teuthology.orchestra.run.smithi138.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T03:47:06.666 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T03:47:06.666 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T03:47:06.666 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:06.666 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:47:06.666 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:06.666 INFO:teuthology.orchestra.run.smithi138.stdout:Install 11 Packages 2024-09-22T03:47:06.666 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:06.667 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 18 M 2024-09-22T03:47:06.667 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 156 M 2024-09-22T03:47:06.667 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:47:07.472 INFO:teuthology.orchestra.run.smithi138.stdout:(1/11): ceph-grafana-dashboards-19.3.0-5092.g62 133 kB/s | 34 kB 00:00 2024-09-22T03:47:07.497 INFO:teuthology.orchestra.run.smithi138.stdout:(2/11): ceph-prometheus-alerts-19.3.0-5092.g62d 58 kB/s | 16 kB 00:00 2024-09-22T03:47:07.622 INFO:teuthology.orchestra.run.smithi138.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.8 MB/s | 269 kB 00:00 2024-09-22T03:47:07.681 INFO:teuthology.orchestra.run.smithi138.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-22T03:47:07.706 INFO:teuthology.orchestra.run.smithi138.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 771 kB/s | 19 kB 00:00 2024-09-22T03:47:07.798 INFO:teuthology.orchestra.run.smithi138.stdout:(6/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.8 MB/s | 863 kB 00:00 2024-09-22T03:47:07.857 INFO:teuthology.orchestra.run.smithi138.stdout:(7/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 14 MB/s | 2.0 MB 00:00 2024-09-22T03:47:07.891 INFO:teuthology.orchestra.run.smithi138.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.1 MB/s | 31 kB 00:00 2024-09-22T03:47:07.924 INFO:teuthology.orchestra.run.smithi138.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 5.8 MB/s | 188 kB 00:00 2024-09-22T03:47:07.958 INFO:teuthology.orchestra.run.smithi138.stdout:(10/11): python3-grpcio-tools-1.46.7-10.el9.x86 906 kB/s | 144 kB 00:00 2024-09-22T03:47:08.775 INFO:teuthology.orchestra.run.smithi138.stdout:(11/11): ceph-mgr-dashboard-19.3.0-5092.g62da54 9.1 MB/s | 14 MB 00:01 2024-09-22T03:47:08.779 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:08.780 INFO:teuthology.orchestra.run.smithi138.stdout:Total 8.6 MB/s | 18 MB 00:02 2024-09-22T03:47:08.811 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:47:08.832 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:47:08.832 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:47:09.080 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:47:09.081 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:47:09.635 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:47:09.732 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-22T03:47:09.762 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-22T03:47:09.863 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-22T03:47:10.014 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-22T03:47:10.067 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-22T03:47:10.151 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-22T03:47:10.194 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-22T03:47:10.231 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-22T03:47:10.272 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5092.g62da54b4.el9 9/11 2024-09-22T03:47:13.485 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5092.g62da54b4.el 10/11 2024-09-22T03:47:13.546 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noa 11/11 2024-09-22T03:47:15.624 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noa 11/11 2024-09-22T03:47:15.624 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5092.g62da54b4.el 1/11 2024-09-22T03:47:15.624 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noa 2/11 2024-09-22T03:47:15.624 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5092.g62da54b4.el9 3/11 2024-09-22T03:47:15.624 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-22T03:47:15.624 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-22T03:47:15.624 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-22T03:47:15.624 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-22T03:47:15.624 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-22T03:47:15.624 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-22T03:47:15.624 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-22T03:47:15.927 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-22T03:47:15.928 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:15.928 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:47:15.928 INFO:teuthology.orchestra.run.smithi138.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T03:47:15.928 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:15.928 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:15.928 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:15.928 INFO:teuthology.orchestra.run.smithi138.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T03:47:15.928 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T03:47:15.928 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T03:47:15.928 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T03:47:15.928 INFO:teuthology.orchestra.run.smithi138.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T03:47:15.928 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T03:47:15.928 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T03:47:15.928 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:15.929 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:16.201 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-22T03:47:16.773 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:38 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:16.905 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:16.906 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-09-22T03:47:16.906 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-22T03:47:16.906 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-09-22T03:47:16.906 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:47:16.906 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 7.4 M 2024-09-22T03:47:16.907 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-22T03:47:16.907 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T03:47:16.907 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T03:47:16.907 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T03:47:16.907 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T03:47:16.907 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T03:47:16.907 INFO:teuthology.orchestra.run.smithi138.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T03:47:16.907 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T03:47:16.907 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T03:47:16.907 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T03:47:16.907 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T03:47:16.907 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T03:47:16.907 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:16.907 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:47:16.908 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-09-22T03:47:16.908 INFO:teuthology.orchestra.run.smithi138.stdout:Install 12 Packages 2024-09-22T03:47:16.908 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:16.908 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 38 M 2024-09-22T03:47:16.908 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 212 M 2024-09-22T03:47:16.908 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:47:17.355 INFO:teuthology.orchestra.run.smithi138.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-22T03:47:17.422 INFO:teuthology.orchestra.run.smithi138.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-22T03:47:17.472 INFO:teuthology.orchestra.run.smithi138.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-22T03:47:17.547 INFO:teuthology.orchestra.run.smithi138.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 243 kB/s | 18 kB 00:00 2024-09-22T03:47:17.606 INFO:teuthology.orchestra.run.smithi138.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2024-09-22T03:47:17.631 INFO:teuthology.orchestra.run.smithi138.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-22T03:47:17.732 INFO:teuthology.orchestra.run.smithi138.stdout:(7/12): ceph-mgr-diskprediction-local-19.3.0-50 13 MB/s | 7.4 MB 00:00 2024-09-22T03:47:17.816 INFO:teuthology.orchestra.run.smithi138.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 24 MB/s | 4.9 MB 00:00 2024-09-22T03:47:17.841 INFO:teuthology.orchestra.run.smithi138.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-09-22T03:47:17.866 INFO:teuthology.orchestra.run.smithi138.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 4.8 MB/s | 250 kB 00:00 2024-09-22T03:47:18.233 INFO:teuthology.orchestra.run.smithi138.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-09-22T03:47:18.408 INFO:teuthology.orchestra.run.smithi138.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.5 MB/s | 5.1 MB 00:00 2024-09-22T03:47:18.409 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:18.410 INFO:teuthology.orchestra.run.smithi138.stdout:Total 25 MB/s | 38 MB 00:01 2024-09-22T03:47:18.763 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:47:18.789 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:47:18.789 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:47:19.219 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:47:19.219 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:47:19.977 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:47:20.056 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-22T03:47:20.099 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-22T03:47:20.198 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-22T03:47:20.250 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-22T03:47:20.436 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-22T03:47:20.466 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-22T03:47:20.542 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-22T03:47:21.201 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-22T03:47:21.322 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-22T03:47:22.578 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T03:47:23.616 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-22T03:47:23.646 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da5 12/12 2024-09-22T03:47:26.355 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da5 12/12 2024-09-22T03:47:26.355 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da5 1/12 2024-09-22T03:47:26.355 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-22T03:47:26.355 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-22T03:47:26.355 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-22T03:47:26.355 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-22T03:47:26.355 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-22T03:47:26.356 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-22T03:47:26.356 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-22T03:47:26.356 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-22T03:47:26.356 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T03:47:26.356 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-22T03:47:26.745 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-22T03:47:26.745 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:26.745 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:47:26.746 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:26.746 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T03:47:26.746 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T03:47:26.746 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T03:47:26.746 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T03:47:26.746 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T03:47:26.746 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T03:47:26.746 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T03:47:26.746 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T03:47:26.746 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T03:47:26.746 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T03:47:26.746 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T03:47:26.746 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:26.747 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:27.152 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-rook 2024-09-22T03:47:27.740 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:49 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:27.872 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:27.874 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:27.874 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-22T03:47:27.874 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:27.874 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:47:27.874 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 49 k 2024-09-22T03:47:27.874 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-22T03:47:27.874 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T03:47:27.874 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T03:47:27.874 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T03:47:27.874 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T03:47:27.874 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T03:47:27.874 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T03:47:27.875 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T03:47:27.875 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T03:47:27.875 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T03:47:27.875 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T03:47:27.875 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T03:47:27.875 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T03:47:27.875 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:27.875 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:47:27.875 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:27.875 INFO:teuthology.orchestra.run.smithi138.stdout:Install 13 Packages 2024-09-22T03:47:27.875 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:27.876 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 2.2 M 2024-09-22T03:47:27.876 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 26 M 2024-09-22T03:47:27.876 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:47:28.185 INFO:teuthology.orchestra.run.smithi138.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 159 kB/s | 19 kB 00:00 2024-09-22T03:47:28.202 INFO:teuthology.orchestra.run.smithi138.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 187 kB/s | 26 kB 00:00 2024-09-22T03:47:28.227 INFO:teuthology.orchestra.run.smithi138.stdout:(3/13): ceph-mgr-rook-19.3.0-5092.g62da54b4.el9 303 kB/s | 49 kB 00:00 2024-09-22T03:47:28.352 INFO:teuthology.orchestra.run.smithi138.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.3 MB/s | 222 kB 00:00 2024-09-22T03:47:28.378 INFO:teuthology.orchestra.run.smithi138.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 903 kB/s | 159 kB 00:00 2024-09-22T03:47:28.411 INFO:teuthology.orchestra.run.smithi138.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 914 kB/s | 54 kB 00:00 2024-09-22T03:47:28.445 INFO:teuthology.orchestra.run.smithi138.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 479 kB/s | 32 kB 00:00 2024-09-22T03:47:28.470 INFO:teuthology.orchestra.run.smithi138.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 247 kB/s | 14 kB 00:00 2024-09-22T03:47:28.496 INFO:teuthology.orchestra.run.smithi138.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.0 MB/s | 279 kB 00:00 2024-09-22T03:47:28.521 INFO:teuthology.orchestra.run.smithi138.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.9 MB/s | 220 kB 00:00 2024-09-22T03:47:28.546 INFO:teuthology.orchestra.run.smithi138.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-22T03:47:28.597 INFO:teuthology.orchestra.run.smithi138.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 8.1 MB/s | 1.0 MB 00:00 2024-09-22T03:47:28.622 INFO:teuthology.orchestra.run.smithi138.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 892 kB/s | 90 kB 00:00 2024-09-22T03:47:28.625 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:28.625 INFO:teuthology.orchestra.run.smithi138.stdout:Total 3.0 MB/s | 2.2 MB 00:00 2024-09-22T03:47:28.689 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:47:28.704 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:47:28.704 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:47:28.793 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:47:28.794 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:47:29.303 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:47:29.478 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-22T03:47:29.532 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-22T03:47:29.587 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-22T03:47:29.625 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-22T03:47:29.666 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-22T03:47:29.768 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-22T03:47:29.871 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-22T03:47:29.936 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-22T03:47:30.647 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-22T03:47:30.692 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-22T03:47:30.743 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-22T03:47:30.790 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-22T03:47:30.813 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 13/13 2024-09-22T03:47:31.633 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 13/13 2024-09-22T03:47:31.633 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 1/13 2024-09-22T03:47:31.633 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-22T03:47:31.633 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-22T03:47:31.633 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-22T03:47:31.633 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-22T03:47:31.634 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-22T03:47:31.634 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-22T03:47:31.634 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-22T03:47:31.634 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-22T03:47:31.634 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-22T03:47:31.634 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-22T03:47:31.634 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-22T03:47:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-22T03:47:31.976 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:31.977 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:47:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T03:47:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T03:47:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T03:47:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T03:47:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T03:47:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T03:47:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T03:47:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T03:47:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T03:47:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T03:47:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T03:47:31.977 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T03:47:31.978 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:31.978 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:32.271 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-cephadm 2024-09-22T03:47:32.853 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:54 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:32.986 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:32.986 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:32.987 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-22T03:47:32.987 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:32.987 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:47:32.987 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 154 k 2024-09-22T03:47:32.987 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-22T03:47:32.987 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T03:47:32.987 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T03:47:32.987 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T03:47:32.987 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T03:47:32.987 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T03:47:32.987 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:32.987 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:47:32.987 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:32.988 INFO:teuthology.orchestra.run.smithi138.stdout:Install 6 Packages 2024-09-22T03:47:32.988 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:32.988 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 7.0 M 2024-09-22T03:47:32.988 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 33 M 2024-09-22T03:47:32.988 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:47:33.270 INFO:teuthology.orchestra.run.smithi138.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-22T03:47:33.295 INFO:teuthology.orchestra.run.smithi138.stdout:(2/6): ceph-mgr-cephadm-19.3.0-5092.g62da54b4.e 683 kB/s | 154 kB 00:00 2024-09-22T03:47:33.354 INFO:teuthology.orchestra.run.smithi138.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 987 kB/s | 58 kB 00:00 2024-09-22T03:47:33.388 INFO:teuthology.orchestra.run.smithi138.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.6 MB/s | 548 kB 00:00 2024-09-22T03:47:33.413 INFO:teuthology.orchestra.run.smithi138.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-22T03:47:33.555 INFO:teuthology.orchestra.run.smithi138.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-22T03:47:33.557 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:33.558 INFO:teuthology.orchestra.run.smithi138.stdout:Total 12 MB/s | 7.0 MB 00:00 2024-09-22T03:47:33.629 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:47:33.640 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:47:33.640 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:47:33.741 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:47:33.742 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:47:34.056 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:47:34.228 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-22T03:47:34.282 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-22T03:47:34.812 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-22T03:47:34.893 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-22T03:47:34.971 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-22T03:47:34.996 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 6/6 2024-09-22T03:47:35.806 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 6/6 2024-09-22T03:47:35.806 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/6 2024-09-22T03:47:35.806 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-22T03:47:35.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-22T03:47:35.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-22T03:47:35.807 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-22T03:47:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-22T03:47:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:36.083 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:47:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T03:47:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T03:47:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T03:47:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T03:47:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T03:47:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:36.084 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:36.355 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-fuse 2024-09-22T03:47:36.938 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:58 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:37.071 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:37.071 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:37.072 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-22T03:47:37.072 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:37.072 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:47:37.072 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 883 k 2024-09-22T03:47:37.072 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-22T03:47:37.072 INFO:teuthology.orchestra.run.smithi138.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T03:47:37.072 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:37.072 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:47:37.072 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:37.072 INFO:teuthology.orchestra.run.smithi138.stdout:Install 2 Packages 2024-09-22T03:47:37.072 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:37.073 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 963 k 2024-09-22T03:47:37.073 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 4.1 M 2024-09-22T03:47:37.073 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:47:37.744 INFO:teuthology.orchestra.run.smithi138.stdout:(1/2): ceph-fuse-19.3.0-5092.g62da54b4.el9.x86_ 1.4 MB/s | 883 kB 00:00 2024-09-22T03:47:37.810 INFO:teuthology.orchestra.run.smithi138.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 115 kB/s | 80 kB 00:00 2024-09-22T03:47:37.811 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:37.812 INFO:teuthology.orchestra.run.smithi138.stdout:Total 1.3 MB/s | 963 kB 00:00 2024-09-22T03:47:37.824 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:47:37.850 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:47:37.850 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:47:37.933 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:47:37.933 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:47:38.133 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:47:38.281 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-22T03:47:38.351 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 2/2 2024-09-22T03:47:39.063 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 2/2 2024-09-22T03:47:39.063 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/2 2024-09-22T03:47:39.350 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-22T03:47:39.350 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:39.350 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:47:39.350 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-22T03:47:39.350 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:39.350 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:39.589 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-volume 2024-09-22T03:47:40.184 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:02 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:40.319 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:40.319 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:40.319 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-22T03:47:40.319 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:40.319 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:47:40.319 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-volume noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 285 k 2024-09-22T03:47:40.320 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:40.320 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:47:40.320 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:40.320 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-22T03:47:40.320 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:40.320 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 285 k 2024-09-22T03:47:40.320 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 1.3 M 2024-09-22T03:47:40.320 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:47:40.627 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-volume-19.3.0-5092.g62da54b4.el9.noarch.rp 931 kB/s | 285 kB 00:00 2024-09-22T03:47:40.627 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:40.628 INFO:teuthology.orchestra.run.smithi138.stdout:Total 927 kB/s | 285 kB 00:00 2024-09-22T03:47:40.628 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:47:40.636 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:47:40.636 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:47:40.666 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:47:40.666 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:47:40.885 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:47:40.945 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:47:40.961 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:47:40.962 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:47:40.962 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T03:47:40.962 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:47:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:41.967 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:47:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:41.967 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:42.290 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librados-devel 2024-09-22T03:47:42.884 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:04 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:43.025 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:43.026 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-09-22T03:47:43.026 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:43.026 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:47:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 125 k 2024-09-22T03:47:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:43.026 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:47:43.026 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:43.026 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-22T03:47:43.027 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:43.027 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 125 k 2024-09-22T03:47:43.027 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 445 k 2024-09-22T03:47:43.027 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:47:43.338 INFO:teuthology.orchestra.run.smithi138.stdout:librados-devel-19.3.0-5092.g62da54b4.el9.x86_64 401 kB/s | 125 kB 00:00 2024-09-22T03:47:43.338 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:43.338 INFO:teuthology.orchestra.run.smithi138.stdout:Total 399 kB/s | 125 kB 00:00 2024-09-22T03:47:43.339 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:47:43.344 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:47:43.344 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:47:43.408 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:47:43.409 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:47:43.556 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:47:43.658 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:47:44.105 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:47:44.357 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:47:44.357 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:44.357 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:47:44.357 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:44.357 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:44.357 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:44.643 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install libcephfs2 2024-09-22T03:47:45.230 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:07 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:45.323 INFO:teuthology.orchestra.run.smithi138.stdout:Package libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:47:45.368 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:45.369 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-22T03:47:45.369 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:45.439 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install libcephfs-devel 2024-09-22T03:47:46.017 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:08 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:46.148 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:46.149 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-09-22T03:47:46.149 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:46.149 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:47:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 32 k 2024-09-22T03:47:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:46.149 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:47:46.150 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:46.150 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-22T03:47:46.150 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:46.150 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 32 k 2024-09-22T03:47:46.150 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 142 k 2024-09-22T03:47:46.150 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:47:46.291 INFO:teuthology.orchestra.run.smithi138.stdout:libcephfs-devel-19.3.0-5092.g62da54b4.el9.x86_6 225 kB/s | 32 kB 00:00 2024-09-22T03:47:46.292 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:46.292 INFO:teuthology.orchestra.run.smithi138.stdout:Total 223 kB/s | 32 kB 00:00 2024-09-22T03:47:46.292 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:47:46.296 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:47:46.296 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:47:46.313 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:47:46.313 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:47:46.396 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:47:46.505 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:47:46.903 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:47:47.138 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:47:47.138 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:47.138 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:47:47.138 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:47.139 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:47.139 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:47.321 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librados2 2024-09-22T03:47:47.904 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:09 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:47.993 INFO:teuthology.orchestra.run.smithi138.stdout:Package librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:47:48.037 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:48.038 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-22T03:47:48.038 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:48.118 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librbd1 2024-09-22T03:47:48.696 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:10 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:48.786 INFO:teuthology.orchestra.run.smithi138.stdout:Package librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:47:48.829 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:48.830 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-22T03:47:48.830 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:48.894 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rados 2024-09-22T03:47:49.472 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:11 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:49.561 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:47:49.604 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:49.605 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-22T03:47:49.606 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:49.673 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rgw 2024-09-22T03:47:50.255 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:12 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:50.345 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:47:50.388 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:50.389 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-22T03:47:50.389 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:50.459 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-cephfs 2024-09-22T03:47:51.037 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:13 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:51.129 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:47:51.172 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:51.173 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-22T03:47:51.173 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:51.246 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rbd 2024-09-22T03:47:51.827 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:13 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:51.917 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:47:51.960 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:51.961 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-22T03:47:51.961 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:52.042 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-fuse 2024-09-22T03:47:52.625 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:14 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:52.760 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:52.760 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:52.761 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-09-22T03:47:52.761 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:52.761 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:47:52.761 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 91 k 2024-09-22T03:47:52.761 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:52.761 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:47:52.761 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:52.761 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-22T03:47:52.761 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:52.761 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 91 k 2024-09-22T03:47:52.761 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 321 k 2024-09-22T03:47:52.761 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:47:52.969 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-fuse-19.3.0-5092.g62da54b4.el9.x86_64.rpm 437 kB/s | 91 kB 00:00 2024-09-22T03:47:52.999 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:52.999 INFO:teuthology.orchestra.run.smithi138.stdout:Total 433 kB/s | 91 kB 00:00 2024-09-22T03:47:52.999 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:47:52.999 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:47:53.000 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:47:53.044 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:47:53.044 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:47:53.192 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:47:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:47:53.670 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:47:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:47:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:53.949 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:47:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:53.949 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:53.949 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:54.309 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-mirror 2024-09-22T03:47:54.920 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:16 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:55.060 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:55.061 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:55.061 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-09-22T03:47:55.061 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:55.061 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:47:55.061 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 3.5 M 2024-09-22T03:47:55.061 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:55.061 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:47:55.061 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:55.061 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-22T03:47:55.061 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:55.062 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 3.5 M 2024-09-22T03:47:55.062 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 30 M 2024-09-22T03:47:55.062 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:47:55.415 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-mirror-19.3.0-5092.g62da54b4.el9.x86_64.rpm 9.9 MB/s | 3.5 MB 00:00 2024-09-22T03:47:55.416 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:55.416 INFO:teuthology.orchestra.run.smithi138.stdout:Total 9.9 MB/s | 3.5 MB 00:00 2024-09-22T03:47:55.416 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:47:55.427 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:47:55.427 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:47:55.511 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:47:55.511 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:47:56.094 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:47:56.157 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:47:56.183 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:47:56.183 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:47:56.183 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T03:47:56.183 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T03:47:56.183 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T03:47:56.184 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:47:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:57.464 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:47:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:57.464 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:47:57.700 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-nbd 2024-09-22T03:47:58.301 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:20 ago on Sun 22 Sep 2024 03:45:38 AM UTC. 2024-09-22T03:47:58.432 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-22T03:47:58.433 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:58.433 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-09-22T03:47:58.433 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:58.433 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-22T03:47:58.433 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 176 k 2024-09-22T03:47:58.433 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:58.433 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-22T03:47:58.433 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-22T03:47:58.433 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-22T03:47:58.434 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:58.434 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 176 k 2024-09-22T03:47:58.434 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 685 k 2024-09-22T03:47:58.434 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-22T03:47:58.693 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-nbd-19.3.0-5092.g62da54b4.el9.x86_64.rpm 680 kB/s | 176 kB 00:00 2024-09-22T03:47:58.694 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:58.694 INFO:teuthology.orchestra.run.smithi138.stdout:Total 676 kB/s | 176 kB 00:00 2024-09-22T03:47:58.694 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-22T03:47:58.704 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-22T03:47:58.704 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-22T03:47:58.767 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-22T03:47:58.768 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-22T03:47:58.927 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-22T03:47:59.040 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:47:59.480 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:47:59.731 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:47:59.732 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:59.732 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-22T03:47:59.732 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:59.732 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:47:59.732 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-22T03:48:00.002 DEBUG:teuthology.parallel:result is None 2024-09-22T03:48:00.003 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-22T03:48:00.145 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T03:48:00.166 INFO:teuthology.orchestra.run.smithi138.stdout:19.3.0-5092.g62da54b4.el9 2024-09-22T03:48:00.166 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5092.g62da54b4.el9 2024-09-22T03:48:00.166 INFO:teuthology.task.install:The correct ceph version 19.3.0-5092.g62da54b4 is installed. 2024-09-22T03:48:00.168 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-22T03:48:00.168 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:00.168 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T03:48:00.232 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-22T03:48:00.232 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:00.232 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T03:48:00.296 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T03:48:00.361 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-22T03:48:00.361 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:00.361 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T03:48:00.425 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T03:48:00.489 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-22T03:48:00.490 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:00.490 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T03:48:00.554 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T03:48:00.618 INFO:teuthology.run_tasks:Running task ceph... 2024-09-22T03:48:00.687 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-22T03:48:00.688 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2024-09-22T03:48:00.712 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-22T03:48:00.712 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T03:48:00.777 INFO:tasks.ceph:Creating extra log directories... 2024-09-22T03:48:00.777 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T03:48:00.849 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-22T03:48:00.849 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-22T03:48:00.849 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914377', 'branch': 'main', 'description': 'crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests_old_format}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7914377', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'}}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 101, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 2950, 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_62da54b4b83a96ca9976b7e1d0c8272a564a2208/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208', 'targets': {'smithi138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKXTA6agvWHUWJQMZ9hZjwa9mtyy143k0pinAiiuWLoewVXIZNBvf3nbvKcmSo7f6TthjIVmMyANKNIF/rsbMjs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rbd/crimson/test_crimson_librbd.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-21_20:56:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-22T03:48:00.850 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T03:48:00.897 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T03:48:00.962 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:00.962 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T03:48:01.018 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T03:48:01.018 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-09-22T03:48:01.072 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T03:48:01.073 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:48:01.073 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-22T03:48:01.073 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:48:01.073 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:48:01.073 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-22 03:47:56.469601283 +0000 2024-09-22T03:48:01.073 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-22 03:45:00.192480993 +0000 2024-09-22T03:48:01.073 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-22 03:45:00.192480993 +0000 2024-09-22T03:48:01.073 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-22 03:45:00.192480993 +0000 2024-09-22T03:48:01.073 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T03:48:01.135 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-22T03:48:01.135 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-22T03:48:01.135 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000187104 s, 2.7 MB/s 2024-09-22T03:48:01.137 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T03:48:01.193 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-09-22T03:48:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T03:48:01.248 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:48:01.249 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-22T03:48:01.249 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:48:01.249 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:48:01.249 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-22 03:47:56.470601260 +0000 2024-09-22T03:48:01.249 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-22 03:45:00.513473738 +0000 2024-09-22T03:48:01.249 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-22 03:45:00.513473738 +0000 2024-09-22T03:48:01.249 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-22 03:45:00.513473738 +0000 2024-09-22T03:48:01.249 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T03:48:01.311 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-22T03:48:01.312 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-22T03:48:01.312 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000186136 s, 2.8 MB/s 2024-09-22T03:48:01.313 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T03:48:01.369 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-09-22T03:48:01.425 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T03:48:01.425 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:48:01.425 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-22T03:48:01.425 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:48:01.425 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:48:01.425 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-22 03:47:56.470601260 +0000 2024-09-22T03:48:01.425 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-22 03:45:00.834466483 +0000 2024-09-22T03:48:01.425 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-22 03:45:00.834466483 +0000 2024-09-22T03:48:01.425 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-22 03:45:00.834466483 +0000 2024-09-22T03:48:01.425 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T03:48:01.487 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-22T03:48:01.487 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-22T03:48:01.487 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000167853 s, 3.1 MB/s 2024-09-22T03:48:01.488 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T03:48:01.544 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-09-22T03:48:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T03:48:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:48:01.600 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-22T03:48:01.600 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:48:01.600 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:48:01.600 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-22 03:47:56.471601237 +0000 2024-09-22T03:48:01.600 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-22 03:45:01.160459114 +0000 2024-09-22T03:48:01.600 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-22 03:45:01.160459114 +0000 2024-09-22T03:48:01.600 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-22 03:45:01.160459114 +0000 2024-09-22T03:48:01.600 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T03:48:01.662 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-22T03:48:01.662 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-22T03:48:01.662 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000168271 s, 3.0 MB/s 2024-09-22T03:48:01.664 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T03:48:01.719 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-22T03:48:01.719 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-22T03:48:01.719 INFO:tasks.ceph:Generating config... 2024-09-22T03:48:01.720 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-22T03:48:01.720 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-22T03:48:01.720 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-22T03:48:01.721 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-22T03:48:01.721 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-22T03:48:01.721 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-22T03:48:01.721 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-22T03:48:01.721 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-22T03:48:01.721 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-22T03:48:01.721 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-22T03:48:01.721 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-22T03:48:01.721 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-22T03:48:01.721 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-22T03:48:01.721 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-22T03:48:01.721 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-22T03:48:01.721 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-22T03:48:01.721 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-22T03:48:01.722 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-22T03:48:01.722 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-22T03:48:01.722 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-22T03:48:01.722 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-22T03:48:01.722 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-22T03:48:01.722 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-22T03:48:01.722 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-22T03:48:01.722 INFO:tasks.ceph:[osd] log to file = False 2024-09-22T03:48:01.722 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-22T03:48:01.722 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-22T03:48:01.722 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-22T03:48:01.722 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-22T03:48:01.722 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-22T03:48:01.722 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-22T03:48:01.722 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-22T03:48:01.723 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-22T03:48:01.723 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-22T03:48:01.723 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-22T03:48:01.723 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-22T03:48:01.723 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-22T03:48:01.723 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-22T03:48:01.723 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-22T03:48:01.723 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-22T03:48:01.723 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-22T03:48:01.723 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-1 2024-09-22T03:48:01.723 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 2-3 2024-09-22T03:48:01.723 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 4-5 2024-09-22T03:48:01.723 INFO:tasks.ceph:Setting up mon.a... 2024-09-22T03:48:01.724 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-22T03:48:01.817 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.keyring 2024-09-22T03:48:01.820 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-22T03:48:01.871 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T03:48:01.896 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.138')] 2024-09-22T03:48:01.896 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.138', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}} 2024-09-22T03:48:01.897 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:01.897 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T03:48:01.950 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.138 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:48:02.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:02.039+0000 7fc46ca32f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:02.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:02.039+0000 7fc46ca32f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:02.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:02.040+0000 7fc46ca32f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:02.042 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:48:02.042 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool: generated fsid 95b2c314-8275-411e-9a40-1e523f23b47f 2024-09-22T03:48:02.042 INFO:teuthology.orchestra.run.smithi138.stdout:setting min_mon_release = quincy 2024-09-22T03:48:02.042 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 0 2024-09-22T03:48:02.042 INFO:teuthology.orchestra.run.smithi138.stdout:fsid 95b2c314-8275-411e-9a40-1e523f23b47f 2024-09-22T03:48:02.042 INFO:teuthology.orchestra.run.smithi138.stdout:last_changed 2024-09-22T03:48:02.041597+0000 2024-09-22T03:48:02.042 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-09-22T03:48:02.041597+0000 2024-09-22T03:48:02.043 INFO:teuthology.orchestra.run.smithi138.stdout:min_mon_release 17 (quincy) 2024-09-22T03:48:02.043 INFO:teuthology.orchestra.run.smithi138.stdout:election_strategy: 1 2024-09-22T03:48:02.043 INFO:teuthology.orchestra.run.smithi138.stdout:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-22T03:48:02.043 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-22T03:48:02.044 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T03:48:02.059 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 95b2c314-8275-411e-9a40-1e523f23b47f... 2024-09-22T03:48:02.059 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T03:48:02.141 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2024-09-22T03:48:02.141 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2024-09-22T03:48:02.141 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T03:48:02.141 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2024-09-22T03:48:02.142 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.142 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2024-09-22T03:48:02.142 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.142 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2024-09-22T03:48:02.142 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.142 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2024-09-22T03:48:02.142 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2024-09-22T03:48:02.142 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.142 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2024-09-22T03:48:02.142 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2024-09-22T03:48:02.142 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.142 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T03:48:02.142 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2024-09-22T03:48:02.142 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.142 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.143 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = 172.21.15.138 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: ms client mode = crc 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: ms cluster mode = crc 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: ms mon client mode = crc 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: ms mon cluster mode = crc 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: ms mon service mode = crc 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: ms service mode = crc 2024-09-22T03:48:02.144 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = 95b2c314-8275-411e-9a40-1e523f23b47f 2024-09-22T03:48:02.145 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.145 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2024-09-22T03:48:02.145 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2024-09-22T03:48:02.145 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.145 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2024-09-22T03:48:02.145 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2024-09-22T03:48:02.145 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2024-09-22T03:48:02.145 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.145 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2024-09-22T03:48:02.145 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2024-09-22T03:48:02.145 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.145 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2024-09-22T03:48:02.145 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2024-09-22T03:48:02.145 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2024-09-22T03:48:02.145 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug trim objects = true 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: debug monc = 20 2024-09-22T03:48:02.146 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore compression algorithm = snappy 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore compression mode = aggressive 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore rocksdb cf = False 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: crimson alien thread cpu cores = 6-7 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: crimson osd obc lru size = 10 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 20 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 20 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 10 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: err to stderr = True 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: log flush on exit = True 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: log to file = False 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: log to stderr = True 2024-09-22T03:48:02.147 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout: osd shutdown pgref assert = True 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2024-09-22T03:48:02.148 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T03:48:02.149 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout: mon min osdmap epochs = 50 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout: mon osdmap full prune interval = 2 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout: mon osdmap full prune min = 15 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout: mon osdmap full prune txsize = 2 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout: paxos service trim min = 10 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default crimson = True 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2024-09-22T03:48:02.150 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2024-09-22T03:48:02.151 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2024-09-22T03:48:02.151 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T03:48:02.151 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T03:48:02.151 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2024-09-22T03:48:02.151 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.0] 2024-09-22T03:48:02.151 INFO:teuthology.orchestra.run.smithi138.stdout: crimson seastar cpu cores = 0-1 2024-09-22T03:48:02.151 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.1] 2024-09-22T03:48:02.151 INFO:teuthology.orchestra.run.smithi138.stdout: crimson seastar cpu cores = 2-3 2024-09-22T03:48:02.151 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.2] 2024-09-22T03:48:02.151 INFO:teuthology.orchestra.run.smithi138.stdout: crimson seastar cpu cores = 4-5 2024-09-22T03:48:02.152 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-22T03:48:02.152 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-22T03:48:02.257 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-22T03:48:02.257 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:02.257 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-22T03:48:02.272 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:02.272 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-22T03:48:02.328 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2024-09-22T03:48:02.328 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:02.328 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T03:48:02.328 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T03:48:02.401 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:02.401 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:48:02.456 INFO:tasks.ceph:Setting up mon nodes... 2024-09-22T03:48:02.457 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-22T03:48:02.457 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T03:48:02.555 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T03:48:02.558 INFO:tasks.ceph:Setting up mds nodes... 2024-09-22T03:48:02.559 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-22T03:48:02.559 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-22T03:48:02.608 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-22T03:48:02.621 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-22T03:48:02.621 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-22T03:48:02.622 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-22T03:48:02.645 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-22T03:48:02.645 INFO:tasks.ceph:role: osd.0 2024-09-22T03:48:02.646 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-22T03:48:02.646 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T03:48:02.717 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T03:48:02.717 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T03:48:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T03:48:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T03:48:02.718 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T03:48:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-22T03:48:02.718 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T03:48:02.718 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T03:48:02.718 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T03:48:02.718 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T03:48:03.213 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-22T03:48:03.215 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-22T03:48:03.216 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-22T03:48:03.326 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-22T03:48:03.359 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-22T03:48:03.425 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-22T03:48:03.425 INFO:tasks.ceph:role: osd.1 2024-09-22T03:48:03.425 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-22T03:48:03.425 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T03:48:03.498 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T03:48:03.498 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T03:48:03.498 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T03:48:03.499 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T03:48:03.499 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T03:48:03.499 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-22T03:48:03.499 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T03:48:03.499 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T03:48:03.499 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T03:48:03.499 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T03:48:03.963 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-22T03:48:03.966 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-22T03:48:03.966 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-22T03:48:04.065 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-22T03:48:04.095 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-22T03:48:04.160 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-22T03:48:04.160 INFO:tasks.ceph:role: osd.2 2024-09-22T03:48:04.160 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-22T03:48:04.160 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-22T03:48:04.232 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T03:48:04.233 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T03:48:04.233 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T03:48:04.233 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T03:48:04.233 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T03:48:04.233 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-22T03:48:04.233 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T03:48:04.234 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T03:48:04.234 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T03:48:04.234 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T03:48:04.727 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-22T03:48:04.729 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-22T03:48:04.729 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-22T03:48:04.858 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-22T03:48:04.889 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:48:05.188 INFO:teuthology.orchestra.run.smithi138.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:48:05.189 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-22 03:48:05,188 seastar - Reactor backend: linux-aio 2024-09-22T03:48:05.200 INFO:teuthology.orchestra.run.smithi138.stderr:==27967==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:48:05.320 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-22 03:48:05,319 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-22T03:48:05.320 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-22 03:48:05,319 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-1 2024-09-22T03:48:05.320 INFO:teuthology.orchestra.run.smithi138.stderr:DEBUG 2024-09-22 03:48:05,320 [shard 0:main] seastar - reactor::drain 2024-09-22T03:48:05.828 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-22T03:48:05.828 INFO:teuthology.orchestra.run.smithi138.stderr:Suppressions used: 2024-09-22T03:48:05.828 INFO:teuthology.orchestra.run.smithi138.stderr: count bytes template 2024-09-22T03:48:05.828 INFO:teuthology.orchestra.run.smithi138.stderr: 1 8 MallocExtension::Register 2024-09-22T03:48:05.828 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-22T03:48:05.828 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-22T03:48:05.885 INFO:teuthology.orchestra.run.smithi138.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:48:05.889 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-22 03:48:05,889 seastar - Reactor backend: linux-aio 2024-09-22T03:48:05.897 INFO:teuthology.orchestra.run.smithi138.stderr:==27965==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:48:10.580 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-22T03:48:10.580 INFO:teuthology.orchestra.run.smithi138.stderr:Suppressions used: 2024-09-22T03:48:10.580 INFO:teuthology.orchestra.run.smithi138.stderr: count bytes template 2024-09-22T03:48:10.580 INFO:teuthology.orchestra.run.smithi138.stderr: 1 8 MallocExtension::Register 2024-09-22T03:48:10.581 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-22T03:48:10.581 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-22T03:48:10.603 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-22T03:48:10.629 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:48:10.906 INFO:teuthology.orchestra.run.smithi138.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:48:10.907 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-22 03:48:10,907 seastar - Reactor backend: linux-aio 2024-09-22T03:48:10.913 INFO:teuthology.orchestra.run.smithi138.stderr:==28151==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:48:11.033 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-22 03:48:11,032 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-22T03:48:11.033 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-22 03:48:11,032 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 2-3 2024-09-22T03:48:11.034 INFO:teuthology.orchestra.run.smithi138.stderr:DEBUG 2024-09-22 03:48:11,033 [shard 0:main] seastar - reactor::drain 2024-09-22T03:48:11.547 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-22T03:48:11.548 INFO:teuthology.orchestra.run.smithi138.stderr:Suppressions used: 2024-09-22T03:48:11.548 INFO:teuthology.orchestra.run.smithi138.stderr: count bytes template 2024-09-22T03:48:11.548 INFO:teuthology.orchestra.run.smithi138.stderr: 1 8 MallocExtension::Register 2024-09-22T03:48:11.548 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-22T03:48:11.548 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-22T03:48:11.603 INFO:teuthology.orchestra.run.smithi138.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:48:11.606 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-22 03:48:11,606 seastar - Reactor backend: linux-aio 2024-09-22T03:48:11.620 INFO:teuthology.orchestra.run.smithi138.stderr:==28149==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:48:16.300 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-22T03:48:16.300 INFO:teuthology.orchestra.run.smithi138.stderr:Suppressions used: 2024-09-22T03:48:16.300 INFO:teuthology.orchestra.run.smithi138.stderr: count bytes template 2024-09-22T03:48:16.300 INFO:teuthology.orchestra.run.smithi138.stderr: 1 8 MallocExtension::Register 2024-09-22T03:48:16.300 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-22T03:48:16.300 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-22T03:48:16.323 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-22T03:48:16.348 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:48:16.627 INFO:teuthology.orchestra.run.smithi138.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:48:16.628 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-22 03:48:16,628 seastar - Reactor backend: linux-aio 2024-09-22T03:48:16.634 INFO:teuthology.orchestra.run.smithi138.stderr:==28335==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:48:16.740 INFO:teuthology.orchestra.run.smithi138.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b6ef 0xbb64079 0xbb655e4 0xbb657fa 0xbb65950 0xbb65e19 0x3e6ef 0x5f68c5f 0x5fccdca 0x5fcd08f 0x5fcd365 0x601ba63 0x601bc69 0x5f9bdb6 0x5f9c2ea 0x5de40ab 0x5dfc2ed 0x713a942 0x714c115 0x714d5b2 0x714d637 0x714d739 0x714d831 0x714da3e 0x714dc24 0x714df73 0x714e317 0x714e547 0x714e7b1 0x714ea7e 0x714ec9c 0x714ed54 0x714ee1a 0x714eefb 0x5c46eec 0x5c46ff6 0x5c470b2 0x5c4716e 0x5c4722a 0x5c47377 0x5c47502 0x5c478c3 0x5c616c6 0xbb78627 0xbb904a5 0xbc3dd4f 0xbc3f39d 0xb90dc6d 0xb90e4a5 0x3961ae8 0x39632c2 0x3803c18 0x2958f 0x2963f 0x35eb9a4 2024-09-22T03:48:16.740 INFO:teuthology.orchestra.run.smithi138.stderr:kernel callstack: 2024-09-22T03:48:16.753 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-22 03:48:16,753 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-22T03:48:16.753 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-22 03:48:16,753 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 4-5 2024-09-22T03:48:16.754 INFO:teuthology.orchestra.run.smithi138.stderr:DEBUG 2024-09-22 03:48:16,754 [shard 0:main] seastar - reactor::drain 2024-09-22T03:48:17.255 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-22T03:48:17.256 INFO:teuthology.orchestra.run.smithi138.stderr:Suppressions used: 2024-09-22T03:48:17.256 INFO:teuthology.orchestra.run.smithi138.stderr: count bytes template 2024-09-22T03:48:17.256 INFO:teuthology.orchestra.run.smithi138.stderr: 1 8 MallocExtension::Register 2024-09-22T03:48:17.256 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-22T03:48:17.256 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-22T03:48:17.313 INFO:teuthology.orchestra.run.smithi138.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:48:17.317 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-22 03:48:17,317 seastar - Reactor backend: linux-aio 2024-09-22T03:48:17.334 INFO:teuthology.orchestra.run.smithi138.stderr:==28333==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:48:22.009 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-22T03:48:22.009 INFO:teuthology.orchestra.run.smithi138.stderr:Suppressions used: 2024-09-22T03:48:22.009 INFO:teuthology.orchestra.run.smithi138.stderr: count bytes template 2024-09-22T03:48:22.009 INFO:teuthology.orchestra.run.smithi138.stderr: 1 8 MallocExtension::Register 2024-09-22T03:48:22.009 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-22T03:48:22.009 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-22T03:48:22.032 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-22T03:48:22.056 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-22T03:48:22.056 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:22.056 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-22T03:48:22.121 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:22.121 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-22T03:48:22.185 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:22.185 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-22T03:48:22.250 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:22.250 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-22T03:48:22.315 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:22.315 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-22T03:48:22.371 INFO:tasks.ceph:Adding keys to all mons... 2024-09-22T03:48:22.371 DEBUG:teuthology.orchestra.run.smithi138:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-22T03:48:22.433 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.x] 2024-09-22T03:48:22.433 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQByk+9mim4gIRAAXDcs3YoHqvcZnxxQ+4wzSg== 2024-09-22T03:48:22.433 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.0] 2024-09-22T03:48:22.434 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQB2k+9mhv9mAhAAjkp8pwOezMBof9DMF6gMmw== 2024-09-22T03:48:22.434 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.1] 2024-09-22T03:48:22.434 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQB7k+9mZg2tLRAAmg28gdyG7LqR2li7v9nvxQ== 2024-09-22T03:48:22.434 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.2] 2024-09-22T03:48:22.434 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCBk+9mSqBYHBAAbgOpyJDzaTvD+s6k82GaJA== 2024-09-22T03:48:22.434 INFO:teuthology.orchestra.run.smithi138.stdout:[client.0] 2024-09-22T03:48:22.434 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQByk+9mD19EJBAANC2q6EuZFmndERnNXJxYSg== 2024-09-22T03:48:22.435 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T03:48:22.537 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T03:48:22.597 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T03:48:22.658 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T03:48:22.718 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T03:48:22.783 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-22T03:48:22.783 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-22T03:48:22.807 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T03:48:22.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:22.949+0000 7fda5bf24c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:22.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:22.949+0000 7fda5bf24c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:22.963 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-22T03:48:22.988 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:48:23.043 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-22T03:48:23.044 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-22T03:48:23.044 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-22T03:48:23.086 INFO:tasks.ceph.mon.a:Started 2024-09-22T03:48:23.086 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-22T03:48:23.086 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-22T03:48:23.086 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-22T03:48:23.088 INFO:tasks.ceph.mgr.x:Started 2024-09-22T03:48:23.088 DEBUG:tasks.ceph:set 0 configs 2024-09-22T03:48:23.088 INFO:tasks.ceph:Setting crush tunables to default 2024-09-22T03:48:23.089 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd crush tunables default 2024-09-22T03:48:23.168 INFO:tasks.ceph.mon.a.smithi138.stderr:2024-09-22T03:48:23.166+0000 7f5d0b6d1c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:23.168 INFO:tasks.ceph.mon.a.smithi138.stderr:2024-09-22T03:48:23.166+0000 7f5d0b6d1c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:23.168 INFO:tasks.ceph.mon.a.smithi138.stderr:2024-09-22T03:48:23.166+0000 7f5d0b6d1c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:23.169 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-09-22T03:48:23.168+0000 7f12a2e32000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:23.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:23.191+0000 7f7d13cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:23.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:23.202+0000 7f7d13cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:23.272 INFO:teuthology.orchestra.run.smithi138.stderr:adjusted tunables profile to default 2024-09-22T03:48:23.284 INFO:tasks.ceph:check_enable_crimson: True 2024-09-22T03:48:23.284 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-22T03:48:23.284 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-22T03:48:23.376 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-09-22T03:48:23.374+0000 7f12a2e32000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:23.376 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-09-22T03:48:23.374+0000 7f12a2e32000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:23.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:23.385+0000 7fc7b8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:23.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:23.394+0000 7fc7b8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:23.476 INFO:tasks.ceph.mon.a.smithi138.stderr:2024-09-22T03:48:23.475+0000 7f5d023f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-22T03:48:23.476 INFO:tasks.ceph.mon.a.smithi138.stderr:Please be aware that this feature is experimental, untested, 2024-09-22T03:48:23.477 INFO:tasks.ceph.mon.a.smithi138.stderr:unsupported, and may result in data corruption, data loss, 2024-09-22T03:48:23.477 INFO:tasks.ceph.mon.a.smithi138.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-22T03:48:23.477 INFO:tasks.ceph.mon.a.smithi138.stderr:feature with important data. 2024-09-22T03:48:23.477 INFO:tasks.ceph.mon.a.smithi138.stderr: 2024-09-22T03:48:24.284 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-22T03:48:24.285 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:24.285 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-22T03:48:24.310 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:24.310 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-22T03:48:24.374 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:48:24.374 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-22T03:48:24.439 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new d1f7f779-0110-429e-b7ad-406a272d9840 0 2024-09-22T03:48:24.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:24.579+0000 7faa55e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:24.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:24.589+0000 7faa55e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:24.669 INFO:teuthology.orchestra.run.smithi138.stdout:0 2024-09-22T03:48:24.681 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 67a2ffcb-0897-47cd-b778-8ad762ae2ccb 1 2024-09-22T03:48:24.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:24.781+0000 7fb99ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:24.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:24.791+0000 7fb99ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:24.869 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-09-22T03:48:24.880 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 003042e9-a66c-450a-972d-fb6ab50eeaee 2 2024-09-22T03:48:24.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:24.981+0000 7f142a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:24.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:24.990+0000 7f142a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:25.070 INFO:teuthology.orchestra.run.smithi138.stdout:2 2024-09-22T03:48:25.081 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-22T03:48:25.111 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-22T03:48:25.111 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-22T03:48:25.154 INFO:tasks.ceph.osd.0:Started 2024-09-22T03:48:25.154 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-22T03:48:25.184 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-22T03:48:25.184 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-22T03:48:25.226 INFO:tasks.ceph.osd.1:Started 2024-09-22T03:48:25.226 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-22T03:48:25.256 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-22T03:48:25.257 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-22T03:48:25.299 INFO:tasks.ceph.osd.2:Started 2024-09-22T03:48:25.299 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:48:25.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:25.464+0000 7f43c1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:25.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:25.473+0000 7f43c1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:25.546 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:25.546 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":6,"fsid":"95b2c314-8275-411e-9a40-1e523f23b47f","created":"2024-09-22T03:48:23.191089+0000","modified":"2024-09-22T03:48:25.069001+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T03:48:25.069001+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"d1f7f779-0110-429e-b7ad-406a272d9840","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"67a2ffcb-0897-47cd-b778-8ad762ae2ccb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"003042e9-a66c-450a-972d-fb6ab50eeaee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:48:25.559 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-22T03:48:25.559 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-22T03:48:25.861 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T03:48:25.966 INFO:teuthology.misc.health.smithi138.stderr:2024-09-22T03:48:25.960+0000 7fc0a4cec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:25.969 INFO:teuthology.misc.health.smithi138.stderr:2024-09-22T03:48:25.968+0000 7fc0a4cec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:26.097 INFO:teuthology.misc.health.smithi138.stdout: 2024-09-22T03:48:26.097 INFO:teuthology.misc.health.smithi138.stdout:{"epoch":6,"fsid":"95b2c314-8275-411e-9a40-1e523f23b47f","created":"2024-09-22T03:48:23.191089+0000","modified":"2024-09-22T03:48:25.069001+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T03:48:25.069001+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"d1f7f779-0110-429e-b7ad-406a272d9840","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"67a2ffcb-0897-47cd-b778-8ad762ae2ccb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"003042e9-a66c-450a-972d-fb6ab50eeaee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:48:26.110 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-22T03:48:28.977 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-09-22T03:48:28.975+0000 7f123fc85640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-22T03:48:32.413 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T03:48:32.522 INFO:teuthology.misc.health.smithi138.stderr:2024-09-22T03:48:32.517+0000 7f1cc3a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:32.526 INFO:teuthology.misc.health.smithi138.stderr:2024-09-22T03:48:32.525+0000 7f1cc3a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:32.718 INFO:teuthology.misc.health.smithi138.stdout: 2024-09-22T03:48:32.718 INFO:teuthology.misc.health.smithi138.stdout:{"epoch":9,"fsid":"95b2c314-8275-411e-9a40-1e523f23b47f","created":"2024-09-22T03:48:23.191089+0000","modified":"2024-09-22T03:48:31.982044+0000","last_up_change":"2024-09-22T03:48:31.982044+0000","last_in_change":"2024-09-22T03:48:25.069001+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"d1f7f779-0110-429e-b7ad-406a272d9840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1295064930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6805","nonce":1295064930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1295064930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1295064930}]},"public_addr":"172.21.15.138:6804/1295064930","cluster_addr":"172.21.15.138:6805/1295064930","heartbeat_back_addr":"172.21.15.138:6802/1295064930","heartbeat_front_addr":"172.21.15.138:6803/1295064930","state":["exists","up"]},{"osd":1,"uuid":"67a2ffcb-0897-47cd-b778-8ad762ae2ccb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1163497318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1163497318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1163497318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1163497318}]},"public_addr":"172.21.15.138:6811/1163497318","cluster_addr":"172.21.15.138:6810/1163497318","heartbeat_back_addr":"172.21.15.138:6813/1163497318","heartbeat_front_addr":"172.21.15.138:6812/1163497318","state":["exists","up"]},{"osd":2,"uuid":"003042e9-a66c-450a-972d-fb6ab50eeaee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1968358473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1968358473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6809","nonce":1968358473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1968358473}]},"public_addr":"172.21.15.138:6806/1968358473","cluster_addr":"172.21.15.138:6807/1968358473","heartbeat_back_addr":"172.21.15.138:6809/1968358473","heartbeat_front_addr":"172.21.15.138:6808/1968358473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:48:32.729 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-22T03:48:32.729 INFO:tasks.ceph:Creating RBD pool 2024-09-22T03:48:32.729 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-22T03:48:32.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:32.827+0000 7fd0e4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:32.838+0000 7fd0e4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:33.985 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'rbd' created 2024-09-22T03:48:34.011 DEBUG:teuthology.orchestra.run.smithi138:> rbd --cluster ceph pool init rbd 2024-09-22T03:48:34.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:34.114+0000 7effe8e7dac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:34.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:34.114+0000 7effe8e7dac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:34.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:34.120+0000 7effe8e7dac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:37.055 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-22T03:48:37.056 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-22T03:48:37.056 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-22T03:48:37.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:37.159+0000 7febb8391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:37.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:37.167+0000 7febb8391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:37.360 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:37.373 INFO:teuthology.orchestra.run.smithi138.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-22T03:48:37.373 INFO:tasks.ceph_manager:config epoch is 1 2024-09-22T03:48:37.373 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-22T03:48:37.373 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-22T03:48:37.373 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-22T03:48:37.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:37.475+0000 7fb4cc791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:37.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:37.482+0000 7fb4cc791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:37.721 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:37.733 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":239825861},{"type":"v1","addr":"172.21.15.138:6801","nonce":239825861}]},"active_addr":"172.21.15.138:6801/239825861","active_change":"2024-09-22T03:48:27.967977+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":1385188039}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":2474497123}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":3780152481}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":1307190553}]}]} 2024-09-22T03:48:37.735 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-22T03:48:37.735 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-22T03:48:37.736 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:48:37.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:37.838+0000 7f864b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:37.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:37.845+0000 7f864b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:38.037 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:38.037 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":14,"fsid":"95b2c314-8275-411e-9a40-1e523f23b47f","created":"2024-09-22T03:48:23.191089+0000","modified":"2024-09-22T03:48:37.009426+0000","last_up_change":"2024-09-22T03:48:31.982044+0000","last_in_change":"2024-09-22T03:48:25.069001+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T03:48:31.993619+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T03:48:33.038521+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d1f7f779-0110-429e-b7ad-406a272d9840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1295064930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6805","nonce":1295064930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1295064930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1295064930}]},"public_addr":"172.21.15.138:6804/1295064930","cluster_addr":"172.21.15.138:6805/1295064930","heartbeat_back_addr":"172.21.15.138:6802/1295064930","heartbeat_front_addr":"172.21.15.138:6803/1295064930","state":["exists","up"]},{"osd":1,"uuid":"67a2ffcb-0897-47cd-b778-8ad762ae2ccb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1163497318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1163497318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1163497318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1163497318}]},"public_addr":"172.21.15.138:6811/1163497318","cluster_addr":"172.21.15.138:6810/1163497318","heartbeat_back_addr":"172.21.15.138:6813/1163497318","heartbeat_front_addr":"172.21.15.138:6812/1163497318","state":["exists","up"]},{"osd":2,"uuid":"003042e9-a66c-450a-972d-fb6ab50eeaee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1968358473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1968358473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6809","nonce":1968358473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1968358473}]},"public_addr":"172.21.15.138:6806/1968358473","cluster_addr":"172.21.15.138:6807/1968358473","heartbeat_back_addr":"172.21.15.138:6809/1968358473","heartbeat_front_addr":"172.21.15.138:6808/1968358473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:48:38.050 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-22T03:48:38.050 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:48:38.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:38.152+0000 7f3407b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:38.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:38.159+0000 7f3407b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:38.354 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:38.354 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":14,"fsid":"95b2c314-8275-411e-9a40-1e523f23b47f","created":"2024-09-22T03:48:23.191089+0000","modified":"2024-09-22T03:48:37.009426+0000","last_up_change":"2024-09-22T03:48:31.982044+0000","last_in_change":"2024-09-22T03:48:25.069001+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T03:48:31.993619+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T03:48:33.038521+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d1f7f779-0110-429e-b7ad-406a272d9840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1295064930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6805","nonce":1295064930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1295064930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1295064930}]},"public_addr":"172.21.15.138:6804/1295064930","cluster_addr":"172.21.15.138:6805/1295064930","heartbeat_back_addr":"172.21.15.138:6802/1295064930","heartbeat_front_addr":"172.21.15.138:6803/1295064930","state":["exists","up"]},{"osd":1,"uuid":"67a2ffcb-0897-47cd-b778-8ad762ae2ccb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1163497318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1163497318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1163497318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1163497318}]},"public_addr":"172.21.15.138:6811/1163497318","cluster_addr":"172.21.15.138:6810/1163497318","heartbeat_back_addr":"172.21.15.138:6813/1163497318","heartbeat_front_addr":"172.21.15.138:6812/1163497318","state":["exists","up"]},{"osd":2,"uuid":"003042e9-a66c-450a-972d-fb6ab50eeaee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1968358473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1968358473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6809","nonce":1968358473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1968358473}]},"public_addr":"172.21.15.138:6806/1968358473","cluster_addr":"172.21.15.138:6807/1968358473","heartbeat_back_addr":"172.21.15.138:6809/1968358473","heartbeat_front_addr":"172.21.15.138:6808/1968358473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:48:38.367 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-22T03:48:38.368 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-22T03:48:38.368 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-22T03:48:38.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:38.476+0000 7f27f0ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:38.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:38.476+0000 7f555724f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:38.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:38.477+0000 7f075c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:38.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:38.486+0000 7f555724f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:38.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:38.486+0000 7f27f0ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:38.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:38.486+0000 7f075c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:38.521 INFO:teuthology.orchestra.run.smithi138.stdout:38654705670 2024-09-22T03:48:38.521 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T03:48:38.522 INFO:teuthology.orchestra.run.smithi138.stdout:34359738375 2024-09-22T03:48:38.522 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T03:48:38.523 INFO:teuthology.orchestra.run.smithi138.stdout:34359738375 2024-09-22T03:48:38.523 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T03:48:38.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:38.630+0000 7f6163abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:38.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:38.630+0000 7f3525991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:38.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:38.630+0000 7f1dda4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:38.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:38.640+0000 7f3525991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:38.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:38.640+0000 7f6163abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:38.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:38.640+0000 7f1dda4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:38.842 INFO:teuthology.orchestra.run.smithi138.stdout:34359738375 2024-09-22T03:48:38.844 INFO:teuthology.orchestra.run.smithi138.stdout:38654705670 2024-09-22T03:48:38.855 INFO:teuthology.orchestra.run.smithi138.stdout:34359738375 2024-09-22T03:48:38.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.2 2024-09-22T03:48:38.857 DEBUG:teuthology.parallel:result is None 2024-09-22T03:48:38.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2024-09-22T03:48:38.858 DEBUG:teuthology.parallel:result is None 2024-09-22T03:48:38.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.0 2024-09-22T03:48:38.869 DEBUG:teuthology.parallel:result is None 2024-09-22T03:48:38.869 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T03:48:38.869 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:48:39.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:39.012+0000 7f2ee7311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:39.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:39.020+0000 7f2ee7311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:39.207 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:39.207 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-22T03:48:39.220 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-22T03:48:38.510534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":81004,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283034516,"statfs":{"total":289910292480,"available":289827344384,"internally_reserved":0,"allocated":487424,"data_stored":1269292,"data_compressed":60100,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.034744+0000","last_change":"2024-09-22T03:48:37.039738+0000","last_active":"2024-09-22T03:48:37.034744+0000","last_peered":"2024-09-22T03:48:37.034744+0000","last_clean":"2024-09-22T03:48:37.034744+0000","last_became_active":"2024-09-22T03:48:35.106569+0000","last_became_peered":"2024-09-22T03:48:35.106569+0000","last_unstale":"2024-09-22T03:48:37.034744+0000","last_undegraded":"2024-09-22T03:48:37.034744+0000","last_fullsized":"2024-09-22T03:48:37.034744+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.038128+0000","last_change":"2024-09-22T03:48:37.043255+0000","last_active":"2024-09-22T03:48:37.038128+0000","last_peered":"2024-09-22T03:48:37.038128+0000","last_clean":"2024-09-22T03:48:37.038128+0000","last_became_active":"2024-09-22T03:48:35.118291+0000","last_became_peered":"2024-09-22T03:48:35.118291+0000","last_unstale":"2024-09-22T03:48:37.038128+0000","last_undegraded":"2024-09-22T03:48:37.038128+0000","last_fullsized":"2024-09-22T03:48:37.038128+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.028762+0000","last_change":"2024-09-22T03:48:37.040780+0000","last_active":"2024-09-22T03:48:37.028762+0000","last_peered":"2024-09-22T03:48:37.028762+0000","last_clean":"2024-09-22T03:48:37.028762+0000","last_became_active":"2024-09-22T03:48:35.094134+0000","last_became_peered":"2024-09-22T03:48:35.094134+0000","last_unstale":"2024-09-22T03:48:37.028762+0000","last_undegraded":"2024-09-22T03:48:37.028762+0000","last_fullsized":"2024-09-22T03:48:37.028762+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.031996+0000","last_change":"2024-09-22T03:48:37.040927+0000","last_active":"2024-09-22T03:48:37.031996+0000","last_peered":"2024-09-22T03:48:37.031996+0000","last_clean":"2024-09-22T03:48:37.031996+0000","last_became_active":"2024-09-22T03:48:35.081605+0000","last_became_peered":"2024-09-22T03:48:35.081605+0000","last_unstale":"2024-09-22T03:48:37.031996+0000","last_undegraded":"2024-09-22T03:48:37.031996+0000","last_fullsized":"2024-09-22T03:48:37.031996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.032028+0000","last_change":"2024-09-22T03:48:37.032028+0000","last_active":"2024-09-22T03:48:37.032028+0000","last_peered":"2024-09-22T03:48:37.032028+0000","last_clean":"2024-09-22T03:48:37.032028+0000","last_became_active":"2024-09-22T03:48:35.093109+0000","last_became_peered":"2024-09-22T03:48:35.093109+0000","last_unstale":"2024-09-22T03:48:37.032028+0000","last_undegraded":"2024-09-22T03:48:37.032028+0000","last_fullsized":"2024-09-22T03:48:37.032028+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.032232+0000","last_change":"2024-09-22T03:48:37.034489+0000","last_active":"2024-09-22T03:48:37.032232+0000","last_peered":"2024-09-22T03:48:37.032232+0000","last_clean":"2024-09-22T03:48:37.032232+0000","last_became_active":"2024-09-22T03:48:35.119446+0000","last_became_peered":"2024-09-22T03:48:35.119446+0000","last_unstale":"2024-09-22T03:48:37.032232+0000","last_undegraded":"2024-09-22T03:48:37.032232+0000","last_fullsized":"2024-09-22T03:48:37.032232+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.028401+0000","last_change":"2024-09-22T03:48:37.032421+0000","last_active":"2024-09-22T03:48:37.028401+0000","last_peered":"2024-09-22T03:48:37.028401+0000","last_clean":"2024-09-22T03:48:37.028401+0000","last_became_active":"2024-09-22T03:48:35.094076+0000","last_became_peered":"2024-09-22T03:48:35.094076+0000","last_unstale":"2024-09-22T03:48:37.028401+0000","last_undegraded":"2024-09-22T03:48:37.028401+0000","last_fullsized":"2024-09-22T03:48:37.028401+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.040392+0000","last_change":"2024-09-22T03:48:37.043010+0000","last_active":"2024-09-22T03:48:37.040392+0000","last_peered":"2024-09-22T03:48:37.040392+0000","last_clean":"2024-09-22T03:48:37.040392+0000","last_became_active":"2024-09-22T03:48:35.080621+0000","last_became_peered":"2024-09-22T03:48:35.080621+0000","last_unstale":"2024-09-22T03:48:37.040392+0000","last_undegraded":"2024-09-22T03:48:37.040392+0000","last_fullsized":"2024-09-22T03:48:37.040392+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":84,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.027893+0000","last_change":"2024-09-22T03:48:34.060794+0000","last_active":"2024-09-22T03:48:37.027893+0000","last_peered":"2024-09-22T03:48:37.027893+0000","last_clean":"2024-09-22T03:48:37.027893+0000","last_became_active":"2024-09-22T03:48:34.046386+0000","last_became_peered":"2024-09-22T03:48:34.046386+0000","last_unstale":"2024-09-22T03:48:37.027893+0000","last_undegraded":"2024-09-22T03:48:37.027893+0000","last_fullsized":"2024-09-22T03:48:37.027893+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:32.982948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:32.982948+0000","last_clean_scrub_stamp":"2024-09-22T03:48:32.982948+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26948,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344892,"statfs":{"total":96636764160,"available":96609169408,"internally_reserved":0,"allocated":118784,"data_stored":29506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":619893,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":619893,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:48:39.220 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:48:39.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:39.323+0000 7f8a12d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:39.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:39.331+0000 7f8a12d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:39.523 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:39.523 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-22T03:48:39.536 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-22T03:48:38.510534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":81004,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283034516,"statfs":{"total":289910292480,"available":289827344384,"internally_reserved":0,"allocated":487424,"data_stored":1269292,"data_compressed":60100,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.034744+0000","last_change":"2024-09-22T03:48:37.039738+0000","last_active":"2024-09-22T03:48:37.034744+0000","last_peered":"2024-09-22T03:48:37.034744+0000","last_clean":"2024-09-22T03:48:37.034744+0000","last_became_active":"2024-09-22T03:48:35.106569+0000","last_became_peered":"2024-09-22T03:48:35.106569+0000","last_unstale":"2024-09-22T03:48:37.034744+0000","last_undegraded":"2024-09-22T03:48:37.034744+0000","last_fullsized":"2024-09-22T03:48:37.034744+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.038128+0000","last_change":"2024-09-22T03:48:37.043255+0000","last_active":"2024-09-22T03:48:37.038128+0000","last_peered":"2024-09-22T03:48:37.038128+0000","last_clean":"2024-09-22T03:48:37.038128+0000","last_became_active":"2024-09-22T03:48:35.118291+0000","last_became_peered":"2024-09-22T03:48:35.118291+0000","last_unstale":"2024-09-22T03:48:37.038128+0000","last_undegraded":"2024-09-22T03:48:37.038128+0000","last_fullsized":"2024-09-22T03:48:37.038128+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.028762+0000","last_change":"2024-09-22T03:48:37.040780+0000","last_active":"2024-09-22T03:48:37.028762+0000","last_peered":"2024-09-22T03:48:37.028762+0000","last_clean":"2024-09-22T03:48:37.028762+0000","last_became_active":"2024-09-22T03:48:35.094134+0000","last_became_peered":"2024-09-22T03:48:35.094134+0000","last_unstale":"2024-09-22T03:48:37.028762+0000","last_undegraded":"2024-09-22T03:48:37.028762+0000","last_fullsized":"2024-09-22T03:48:37.028762+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.031996+0000","last_change":"2024-09-22T03:48:37.040927+0000","last_active":"2024-09-22T03:48:37.031996+0000","last_peered":"2024-09-22T03:48:37.031996+0000","last_clean":"2024-09-22T03:48:37.031996+0000","last_became_active":"2024-09-22T03:48:35.081605+0000","last_became_peered":"2024-09-22T03:48:35.081605+0000","last_unstale":"2024-09-22T03:48:37.031996+0000","last_undegraded":"2024-09-22T03:48:37.031996+0000","last_fullsized":"2024-09-22T03:48:37.031996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.032028+0000","last_change":"2024-09-22T03:48:37.032028+0000","last_active":"2024-09-22T03:48:37.032028+0000","last_peered":"2024-09-22T03:48:37.032028+0000","last_clean":"2024-09-22T03:48:37.032028+0000","last_became_active":"2024-09-22T03:48:35.093109+0000","last_became_peered":"2024-09-22T03:48:35.093109+0000","last_unstale":"2024-09-22T03:48:37.032028+0000","last_undegraded":"2024-09-22T03:48:37.032028+0000","last_fullsized":"2024-09-22T03:48:37.032028+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.032232+0000","last_change":"2024-09-22T03:48:37.034489+0000","last_active":"2024-09-22T03:48:37.032232+0000","last_peered":"2024-09-22T03:48:37.032232+0000","last_clean":"2024-09-22T03:48:37.032232+0000","last_became_active":"2024-09-22T03:48:35.119446+0000","last_became_peered":"2024-09-22T03:48:35.119446+0000","last_unstale":"2024-09-22T03:48:37.032232+0000","last_undegraded":"2024-09-22T03:48:37.032232+0000","last_fullsized":"2024-09-22T03:48:37.032232+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.028401+0000","last_change":"2024-09-22T03:48:37.032421+0000","last_active":"2024-09-22T03:48:37.028401+0000","last_peered":"2024-09-22T03:48:37.028401+0000","last_clean":"2024-09-22T03:48:37.028401+0000","last_became_active":"2024-09-22T03:48:35.094076+0000","last_became_peered":"2024-09-22T03:48:35.094076+0000","last_unstale":"2024-09-22T03:48:37.028401+0000","last_undegraded":"2024-09-22T03:48:37.028401+0000","last_fullsized":"2024-09-22T03:48:37.028401+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.040392+0000","last_change":"2024-09-22T03:48:37.043010+0000","last_active":"2024-09-22T03:48:37.040392+0000","last_peered":"2024-09-22T03:48:37.040392+0000","last_clean":"2024-09-22T03:48:37.040392+0000","last_became_active":"2024-09-22T03:48:35.080621+0000","last_became_peered":"2024-09-22T03:48:35.080621+0000","last_unstale":"2024-09-22T03:48:37.040392+0000","last_undegraded":"2024-09-22T03:48:37.040392+0000","last_fullsized":"2024-09-22T03:48:37.040392+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":84,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:48:37.027893+0000","last_change":"2024-09-22T03:48:34.060794+0000","last_active":"2024-09-22T03:48:37.027893+0000","last_peered":"2024-09-22T03:48:37.027893+0000","last_clean":"2024-09-22T03:48:37.027893+0000","last_became_active":"2024-09-22T03:48:34.046386+0000","last_became_peered":"2024-09-22T03:48:34.046386+0000","last_unstale":"2024-09-22T03:48:37.027893+0000","last_undegraded":"2024-09-22T03:48:37.027893+0000","last_fullsized":"2024-09-22T03:48:37.027893+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:32.982948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:32.982948+0000","last_clean_scrub_stamp":"2024-09-22T03:48:32.982948+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26948,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344892,"statfs":{"total":96636764160,"available":96609169408,"internally_reserved":0,"allocated":118784,"data_stored":29506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":619893,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":619893,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:48:39.537 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T03:48:39.537 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-22T03:48:39.537 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-22T03:48:39.537 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-22T03:48:39.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:39.638+0000 7fb08267d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:39.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T03:48:39.644+0000 7fb08267d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:39.872 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T03:48:39.873 INFO:teuthology.orchestra.run.smithi138.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-22T03:48:39.885 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-22T03:48:39.885 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T03:48:39.899 INFO:tasks.workunit:Pulling workunits from ref 62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-22T03:48:39.900 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T03:48:39.900 DEBUG:teuthology.orchestra.run.smithi138:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T03:48:39.915 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T03:48:39.916 INFO:teuthology.orchestra.run.smithi138.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T03:48:39.916 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T03:48:39.971 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T03:48:39.971 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T03:48:40.027 INFO:tasks.workunit:timeout=3h 2024-09-22T03:48:40.027 INFO:tasks.workunit:cleanup=True 2024-09-22T03:48:40.027 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-22T03:48:40.084 INFO:tasks.workunit.client.0.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T03:49:36.528 INFO:tasks.workunit.client.0.smithi138.stderr:Note: switching to '62da54b4b83a96ca9976b7e1d0c8272a564a2208'. 2024-09-22T03:49:36.528 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-22T03:49:36.528 INFO:tasks.workunit.client.0.smithi138.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T03:49:36.528 INFO:tasks.workunit.client.0.smithi138.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T03:49:36.528 INFO:tasks.workunit.client.0.smithi138.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T03:49:36.529 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-22T03:49:36.529 INFO:tasks.workunit.client.0.smithi138.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T03:49:36.529 INFO:tasks.workunit.client.0.smithi138.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T03:49:36.529 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-22T03:49:36.529 INFO:tasks.workunit.client.0.smithi138.stderr: git switch -c 2024-09-22T03:49:36.529 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-22T03:49:36.529 INFO:tasks.workunit.client.0.smithi138.stderr:Or undo this operation with: 2024-09-22T03:49:36.529 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-22T03:49:36.529 INFO:tasks.workunit.client.0.smithi138.stderr: git switch - 2024-09-22T03:49:36.529 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-22T03:49:36.529 INFO:tasks.workunit.client.0.smithi138.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T03:49:36.529 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-22T03:49:36.529 INFO:tasks.workunit.client.0.smithi138.stderr:HEAD is now at 62da54b4b83 Merge pull request #59904 from mcv21/patch-2 2024-09-22T03:49:36.530 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T03:49:36.637 INFO:tasks.workunit.client.0.smithi138.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T03:49:36.639 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T03:49:36.639 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T03:49:37.328 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T03:49:37.406 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T03:49:37.447 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T03:49:37.449 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T03:49:37.449 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T03:49:37.489 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T03:49:37.492 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-22T03:49:37.492 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T03:49:37.508 INFO:tasks.workunit:Running workunits matching rbd/crimson/test_crimson_librbd.sh on client.0... 2024-09-22T03:49:37.509 INFO:tasks.workunit:Running workunit rbd/crimson/test_crimson_librbd.sh... 2024-09-22T03:49:37.510 DEBUG:teuthology.orchestra.run.smithi138:workunit test rbd/crimson/test_crimson_librbd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=62da54b4b83a96ca9976b7e1d0c8272a564a2208 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh 2024-09-22T03:49:37.616 INFO:tasks.workunit.client.0.smithi138.stdout:seed 30606 2024-09-22T03:49:37.616 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = TestLibRBD.* 2024-09-22T03:49:37.616 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 171 tests from 1 test suite. 2024-09-22T03:49:37.616 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T03:49:37.616 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 171 tests from TestLibRBD 2024-09-22T03:49:37.662 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.CreateAndStat 2024-09-22T03:49:39.222 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:41.344 INFO:tasks.workunit.client.0.smithi138.stdout:image has size 2097152 and order 22 2024-09-22T03:49:41.345 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.CreateAndStat (3682 ms) 2024-09-22T03:49:41.345 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.CreateWithSameDataPool 2024-09-22T03:49:41.345 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:780: Skipped 2024-09-22T03:49:41.345 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:49:41.345 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.CreateWithSameDataPool (0 ms) 2024-09-22T03:49:41.345 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.CreateAndStatPP 2024-09-22T03:49:41.345 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:41.435 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.CreateAndStatPP (90 ms) 2024-09-22T03:49:41.435 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.GetId 2024-09-22T03:49:41.435 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:41.518 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.GetId (84 ms) 2024-09-22T03:49:41.518 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.GetIdPP 2024-09-22T03:49:41.519 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:41.613 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.GetIdPP (94 ms) 2024-09-22T03:49:41.613 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefix 2024-09-22T03:49:41.613 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:41.703 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.GetBlockNamePrefix (90 ms) 2024-09-22T03:49:41.703 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefixPP 2024-09-22T03:49:41.703 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:41.787 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.GetBlockNamePrefixPP (85 ms) 2024-09-22T03:49:41.787 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestGetCreateTimestamp 2024-09-22T03:49:41.788 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:939: Skipped 2024-09-22T03:49:41.788 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:49:41.788 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestGetCreateTimestamp (0 ms) 2024-09-22T03:49:41.788 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.GetCreateTimestampPP 2024-09-22T03:49:41.788 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:962: Skipped 2024-09-22T03:49:41.788 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:49:41.788 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.GetCreateTimestampPP (0 ms) 2024-09-22T03:49:41.788 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.OpenAio 2024-09-22T03:49:41.788 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:41.873 INFO:tasks.workunit.client.0.smithi138.stdout:image has size 2097152 and order 22 2024-09-22T03:49:41.873 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.OpenAio (86 ms) 2024-09-22T03:49:41.873 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.OpenAioFail 2024-09-22T03:49:41.885 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.OpenAioFail (11 ms) 2024-09-22T03:49:41.885 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.OpenAioPP 2024-09-22T03:49:41.885 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:42.025 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.OpenAioPP (141 ms) 2024-09-22T03:49:42.025 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.OpenAioFailPP 2024-09-22T03:49:42.037 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.OpenAioFailPP (12 ms) 2024-09-22T03:49:42.038 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ResizeAndStat 2024-09-22T03:49:42.038 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:42.235 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.ResizeAndStat (198 ms) 2024-09-22T03:49:42.235 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ResizeAndStatPP 2024-09-22T03:49:42.235 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:42.407 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.ResizeAndStatPP (172 ms) 2024-09-22T03:49:42.408 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResize 2024-09-22T03:49:42.408 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:42.609 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.UpdateWatchAndResize (201 ms) 2024-09-22T03:49:42.609 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResizePP 2024-09-22T03:49:42.609 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:42.803 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.UpdateWatchAndResizePP (194 ms) 2024-09-22T03:49:42.803 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCreateLsDelete 2024-09-22T03:49:44.516 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:46.355 INFO:tasks.workunit.client.0.smithi138.stdout:image: image15 2024-09-22T03:49:46.356 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image15 2024-09-22T03:49:46.356 INFO:tasks.workunit.client.0.smithi138.stdout:found image15 2024-09-22T03:49:46.356 INFO:tasks.workunit.client.0.smithi138.stdout:erased image15 2024-09-22T03:49:46.356 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:46.589 INFO:tasks.workunit.client.0.smithi138.stdout:image: image15 2024-09-22T03:49:46.589 INFO:tasks.workunit.client.0.smithi138.stdout:image: image16 2024-09-22T03:49:46.589 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image15 2024-09-22T03:49:46.589 INFO:tasks.workunit.client.0.smithi138.stdout:found image15 2024-09-22T03:49:46.589 INFO:tasks.workunit.client.0.smithi138.stdout:erased image15 2024-09-22T03:49:46.589 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image16 2024-09-22T03:49:46.589 INFO:tasks.workunit.client.0.smithi138.stdout:found image16 2024-09-22T03:49:46.590 INFO:tasks.workunit.client.0.smithi138.stdout:erased image16 2024-09-22T03:49:46.590 INFO:tasks.workunit.client.0.smithi138.stdout:image: image16 2024-09-22T03:49:46.590 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image16 2024-09-22T03:49:46.590 INFO:tasks.workunit.client.0.smithi138.stdout:found image16 2024-09-22T03:49:46.590 INFO:tasks.workunit.client.0.smithi138.stdout:erased image16 2024-09-22T03:49:46.590 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCreateLsDelete (3787 ms) 2024-09-22T03:49:46.590 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCreateLsDeletePP 2024-09-22T03:49:48.272 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:50.392 INFO:tasks.workunit.client.0.smithi138.stdout:num images is: 1 2024-09-22T03:49:50.392 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 1 2024-09-22T03:49:50.392 INFO:tasks.workunit.client.0.smithi138.stdout:image: image17 2024-09-22T03:49:50.392 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image17 2024-09-22T03:49:50.392 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:50.442 INFO:tasks.workunit.client.0.smithi138.stdout:num images is: 2 2024-09-22T03:49:50.442 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 2 2024-09-22T03:49:50.442 INFO:tasks.workunit.client.0.smithi138.stdout:image: image17 2024-09-22T03:49:50.443 INFO:tasks.workunit.client.0.smithi138.stdout:image: image18 2024-09-22T03:49:50.443 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image17 2024-09-22T03:49:50.443 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image18 2024-09-22T03:49:50.550 INFO:tasks.workunit.client.0.smithi138.stdout:num images is: 1 2024-09-22T03:49:50.550 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 1 2024-09-22T03:49:50.550 INFO:tasks.workunit.client.0.smithi138.stdout:image: image18 2024-09-22T03:49:50.550 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image18 2024-09-22T03:49:50.550 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCreateLsDeletePP (3961 ms) 2024-09-22T03:49:50.551 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCopy 2024-09-22T03:49:52.285 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:49:59.740 INFO:tasks.workunit.client.0.smithi138.stdout:image: image19 2024-09-22T03:49:59.740 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image19 2024-09-22T03:49:59.740 INFO:tasks.workunit.client.0.smithi138.stdout:found image19 2024-09-22T03:49:59.740 INFO:tasks.workunit.client.0.smithi138.stdout:erased image19 2024-09-22T03:49:59.740 INFO:tasks.workunit.client.0.smithi138.stdout:image: image19 2024-09-22T03:49:59.740 INFO:tasks.workunit.client.0.smithi138.stdout:image: image20 2024-09-22T03:49:59.740 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image19 2024-09-22T03:49:59.740 INFO:tasks.workunit.client.0.smithi138.stdout:found image19 2024-09-22T03:49:59.740 INFO:tasks.workunit.client.0.smithi138.stdout:erased image19 2024-09-22T03:49:59.740 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image20 2024-09-22T03:49:59.740 INFO:tasks.workunit.client.0.smithi138.stdout:found image20 2024-09-22T03:49:59.741 INFO:tasks.workunit.client.0.smithi138.stdout:erased image20 2024-09-22T03:49:59.741 INFO:tasks.workunit.client.0.smithi138.stdout:0.00% done 2024-09-22T03:49:59.741 INFO:tasks.workunit.client.0.smithi138.stdout:100.00% done 2024-09-22T03:49:59.741 INFO:tasks.workunit.client.0.smithi138.stdout:image: image19 2024-09-22T03:49:59.741 INFO:tasks.workunit.client.0.smithi138.stdout:image: image20 2024-09-22T03:49:59.741 INFO:tasks.workunit.client.0.smithi138.stdout:image: image21 2024-09-22T03:49:59.741 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image19 2024-09-22T03:49:59.741 INFO:tasks.workunit.client.0.smithi138.stdout:found image19 2024-09-22T03:49:59.741 INFO:tasks.workunit.client.0.smithi138.stdout:erased image19 2024-09-22T03:49:59.741 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image20 2024-09-22T03:49:59.741 INFO:tasks.workunit.client.0.smithi138.stdout:found image20 2024-09-22T03:49:59.741 INFO:tasks.workunit.client.0.smithi138.stdout:erased image20 2024-09-22T03:49:59.741 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image21 2024-09-22T03:49:59.741 INFO:tasks.workunit.client.0.smithi138.stdout:found image21 2024-09-22T03:49:59.741 INFO:tasks.workunit.client.0.smithi138.stdout:erased image21 2024-09-22T03:49:59.742 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCopy (9189 ms) 2024-09-22T03:49:59.742 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCopyPP 2024-09-22T03:50:01.336 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:50:05.975 INFO:tasks.workunit.client.0.smithi138.stdout:num images is: 1 2024-09-22T03:50:05.975 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 1 2024-09-22T03:50:05.975 INFO:tasks.workunit.client.0.smithi138.stdout:image: image22 2024-09-22T03:50:05.975 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image22 2024-09-22T03:50:07.690 INFO:tasks.workunit.client.0.smithi138.stdout:num images is: 2 2024-09-22T03:50:07.690 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 2 2024-09-22T03:50:07.690 INFO:tasks.workunit.client.0.smithi138.stdout:image: image22 2024-09-22T03:50:07.691 INFO:tasks.workunit.client.0.smithi138.stdout:image: image23 2024-09-22T03:50:07.691 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image22 2024-09-22T03:50:07.691 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image23 2024-09-22T03:50:08.377 INFO:tasks.workunit.client.0.smithi138.stdout:0.00% done 2024-09-22T03:50:08.378 INFO:tasks.workunit.client.0.smithi138.stdout:100.00% done 2024-09-22T03:50:08.378 INFO:tasks.workunit.client.0.smithi138.stdout:num images is: 3 2024-09-22T03:50:08.378 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 3 2024-09-22T03:50:08.378 INFO:tasks.workunit.client.0.smithi138.stdout:image: image22 2024-09-22T03:50:08.378 INFO:tasks.workunit.client.0.smithi138.stdout:image: image23 2024-09-22T03:50:08.378 INFO:tasks.workunit.client.0.smithi138.stdout:image: image24 2024-09-22T03:50:08.378 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image22 2024-09-22T03:50:08.378 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image23 2024-09-22T03:50:08.378 INFO:tasks.workunit.client.0.smithi138.stdout:expected = image24 2024-09-22T03:50:09.005 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCopyPP (9266 ms) 2024-09-22T03:50:09.006 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestDeepCopy 2024-09-22T03:50:09.006 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:1578: Skipped 2024-09-22T03:50:09.006 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:50:09.006 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopy (0 ms) 2024-09-22T03:50:09.006 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestDeepCopyPP 2024-09-22T03:50:09.006 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:1745: Skipped 2024-09-22T03:50:09.006 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:50:09.006 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopyPP (0 ms) 2024-09-22T03:50:09.006 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnap 2024-09-22T03:50:09.006 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:50:12.552 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 1 2024-09-22T03:50:12.552 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 1 2024-09-22T03:50:12.552 INFO:tasks.workunit.client.0.smithi138.stdout:snap: snap1 2024-09-22T03:50:12.552 INFO:tasks.workunit.client.0.smithi138.stdout:found snap1 with size 2097152 2024-09-22T03:50:12.552 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 2 2024-09-22T03:50:12.552 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 2 2024-09-22T03:50:12.552 INFO:tasks.workunit.client.0.smithi138.stdout:snap: snap1 2024-09-22T03:50:12.553 INFO:tasks.workunit.client.0.smithi138.stdout:snap: snap2 2024-09-22T03:50:12.553 INFO:tasks.workunit.client.0.smithi138.stdout:found snap1 with size 2097152 2024-09-22T03:50:12.553 INFO:tasks.workunit.client.0.smithi138.stdout:found snap2 with size 4194304 2024-09-22T03:50:12.553 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 1 2024-09-22T03:50:12.553 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 1 2024-09-22T03:50:12.553 INFO:tasks.workunit.client.0.smithi138.stdout:snap: snap2 2024-09-22T03:50:12.553 INFO:tasks.workunit.client.0.smithi138.stdout:found snap2 with size 4194304 2024-09-22T03:50:12.553 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 0 2024-09-22T03:50:12.553 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 0 2024-09-22T03:50:12.553 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnap (3546 ms) 2024-09-22T03:50:12.553 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestGetSnapShotTimeStamp 2024-09-22T03:50:12.553 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:1890: Skipped 2024-09-22T03:50:12.553 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:50:12.553 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestGetSnapShotTimeStamp (0 ms) 2024-09-22T03:50:12.553 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnapPP 2024-09-22T03:50:12.554 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:50:13.526 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 1 2024-09-22T03:50:13.526 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 1 2024-09-22T03:50:13.526 INFO:tasks.workunit.client.0.smithi138.stdout:snap: snap1 2024-09-22T03:50:13.526 INFO:tasks.workunit.client.0.smithi138.stdout:found snap1 with size 2097152 2024-09-22T03:50:14.530 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 2 2024-09-22T03:50:14.530 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 2 2024-09-22T03:50:14.530 INFO:tasks.workunit.client.0.smithi138.stdout:snap: snap1 2024-09-22T03:50:14.530 INFO:tasks.workunit.client.0.smithi138.stdout:snap: snap2 2024-09-22T03:50:14.530 INFO:tasks.workunit.client.0.smithi138.stdout:found snap1 with size 2097152 2024-09-22T03:50:14.530 INFO:tasks.workunit.client.0.smithi138.stdout:found snap2 with size 4194304 2024-09-22T03:50:15.538 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 1 2024-09-22T03:50:15.539 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 1 2024-09-22T03:50:15.539 INFO:tasks.workunit.client.0.smithi138.stdout:snap: snap2 2024-09-22T03:50:15.539 INFO:tasks.workunit.client.0.smithi138.stdout:found snap2 with size 4194304 2024-09-22T03:50:16.601 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 0 2024-09-22T03:50:16.601 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 0 2024-09-22T03:50:16.618 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnapPP (4066 ms) 2024-09-22T03:50:16.618 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestGetNameIdSnapPP 2024-09-22T03:50:16.618 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:50:22.549 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 0 2024-09-22T03:50:22.549 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 0 2024-09-22T03:50:22.561 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestGetNameIdSnapPP (5944 ms) 2024-09-22T03:50:22.562 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCreateLsRenameSnapPP 2024-09-22T03:50:22.562 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:50:23.568 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 1 2024-09-22T03:50:23.568 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 1 2024-09-22T03:50:23.568 INFO:tasks.workunit.client.0.smithi138.stdout:snap: snap1 2024-09-22T03:50:23.568 INFO:tasks.workunit.client.0.smithi138.stdout:found snap1 with size 2097152 2024-09-22T03:50:24.640 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 2 2024-09-22T03:50:24.640 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 2 2024-09-22T03:50:24.640 INFO:tasks.workunit.client.0.smithi138.stdout:snap: snap1 2024-09-22T03:50:24.640 INFO:tasks.workunit.client.0.smithi138.stdout:snap: snap2 2024-09-22T03:50:24.640 INFO:tasks.workunit.client.0.smithi138.stdout:found snap1 with size 2097152 2024-09-22T03:50:24.640 INFO:tasks.workunit.client.0.smithi138.stdout:found snap2 with size 4194304 2024-09-22T03:50:24.690 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 2 2024-09-22T03:50:24.690 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 2 2024-09-22T03:50:24.690 INFO:tasks.workunit.client.0.smithi138.stdout:snap: snap1-rename 2024-09-22T03:50:24.691 INFO:tasks.workunit.client.0.smithi138.stdout:snap: snap2 2024-09-22T03:50:24.691 INFO:tasks.workunit.client.0.smithi138.stdout:found snap1-rename with size 2097152 2024-09-22T03:50:24.691 INFO:tasks.workunit.client.0.smithi138.stdout:found snap2 with size 4194304 2024-09-22T03:50:25.628 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 1 2024-09-22T03:50:25.628 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 1 2024-09-22T03:50:25.628 INFO:tasks.workunit.client.0.smithi138.stdout:snap: snap2-rename 2024-09-22T03:50:25.628 INFO:tasks.workunit.client.0.smithi138.stdout:found snap2-rename with size 4194304 2024-09-22T03:50:26.580 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 0 2024-09-22T03:50:26.580 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 0 2024-09-22T03:50:26.594 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCreateLsRenameSnapPP (4033 ms) 2024-09-22T03:50:26.594 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ConcurrentCreatesUnvalidatedPool 2024-09-22T03:50:28.450 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:50:28.450 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:50:28.450 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:50:28.450 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:50:31.083 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.ConcurrentCreatesUnvalidatedPool (4489 ms) 2024-09-22T03:50:31.083 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.RemoveFullTry 2024-09-22T03:50:35.715 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:50:54.095 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.RemoveFullTry (23011 ms) 2024-09-22T03:50:54.095 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.RemoveFullTryDataPool 2024-09-22T03:50:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:2227: Skipped 2024-09-22T03:50:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:50:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryDataPool (0 ms) 2024-09-22T03:50:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespace 2024-09-22T03:50:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:2247: Skipped 2024-09-22T03:50:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:50:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespace (0 ms) 2024-09-22T03:50:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespaceDataPool 2024-09-22T03:50:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:2269: Skipped 2024-09-22T03:50:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:50:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespaceDataPool (0 ms) 2024-09-22T03:50:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestIO 2024-09-22T03:50:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:51:18.248 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:51:18.248 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:51:18.248 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:51:18.248 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:51:18.248 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:51:18.248 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.248 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:51:18.248 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.248 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.249 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:51:18.249 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.249 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:51:18.249 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.249 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.249 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:51:18.249 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.249 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:51:18.249 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.249 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.249 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:51:18.249 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.249 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:51:18.249 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.250 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.250 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:51:18.250 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.250 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:51:18.250 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.250 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.250 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:51:18.250 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:51:18.250 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:51:18.250 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:51:18.250 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:51:18.250 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:51:18.250 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:51:18.250 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:51:18.251 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:51:18.251 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:51:18.251 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:51:18.251 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.251 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:51:18.251 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.251 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.251 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:51:18.251 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.251 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:51:18.251 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.251 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.251 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:51:18.252 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:51:18.253 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:51:18.254 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.254 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:51:18.254 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:51:18.254 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:51:18.254 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.254 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:51:18.254 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:51:18.254 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:51:18.254 INFO:tasks.workunit.client.0.smithi138.stdout:discard: 512~512 = 512 2024-09-22T03:51:18.254 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.254 INFO:tasks.workunit.client.0.smithi138.stdout:aio discard: 1536~512 = 0 2024-09-22T03:51:18.254 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:51:18.254 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:51:18.254 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:51:18.254 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 0 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 0 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 16384 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 16384 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:18.255 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 49152 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 49152 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 65536 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 65536 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 98304 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.256 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.257 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 98304 2024-09-22T03:51:18.257 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.257 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.257 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 114688 2024-09-22T03:51:18.257 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.257 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.257 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 114688 2024-09-22T03:51:18.257 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.257 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.257 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:18.257 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:18.257 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 147456 2024-09-22T03:51:18.257 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.257 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.258 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 147456 2024-09-22T03:51:18.258 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.258 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.258 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 163840 2024-09-22T03:51:18.258 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.258 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.258 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 163840 2024-09-22T03:51:18.258 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.258 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.258 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:18.258 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:18.258 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 196608 2024-09-22T03:51:18.258 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.259 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.259 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 196608 2024-09-22T03:51:18.259 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.259 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.259 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 212992 2024-09-22T03:51:18.259 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.259 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.259 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 212992 2024-09-22T03:51:18.259 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.259 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.259 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:18.259 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:18.259 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.259 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:18.259 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.260 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.260 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:18.260 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.260 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.260 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.260 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:18.260 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.260 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.260 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:18.260 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.260 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.260 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.260 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:18.260 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.260 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.261 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:18.261 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.261 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.261 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.261 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:18.261 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.261 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.261 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:18.261 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.261 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.261 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.261 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:18.261 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:18.261 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.262 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:18.262 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:18.262 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.262 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:18.262 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.262 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.262 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:18.262 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.262 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.262 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:18.262 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:18.262 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:18.262 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:18.262 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:18.262 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:18.263 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:18.263 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.677 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.677 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:38.678 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:38.678 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:38.678 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:38.678 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:38.678 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.678 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.678 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:38.678 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:38.678 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:38.678 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:38.678 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:38.678 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.678 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:38.680 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:38.680 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:38.680 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:38.680 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:38.680 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.680 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.680 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:38.680 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:38.680 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:38.680 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:38.680 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:38.680 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.680 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.680 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:38.681 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:38.681 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:38.681 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:38.681 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:38.681 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.681 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.681 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:38.681 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.681 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.681 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:38.681 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.681 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.681 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:38.682 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:38.682 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:38.682 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:38.682 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:38.682 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.682 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.682 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:38.682 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:38.682 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:38.682 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:38.682 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:38.683 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.683 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.683 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:38.683 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:38.683 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:38.683 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:38.683 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:38.683 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.683 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.683 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:38.683 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:38.683 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:38.683 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:38.685 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.685 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.685 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:38.685 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:38.685 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:38.685 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:38.685 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:38.685 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.685 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.685 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:51:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:51:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:51:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:51:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:51:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:51:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:51:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:51:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:51:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:51:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:51:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:51:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestIO (44582 ms) 2024-09-22T03:51:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS1 2024-09-22T03:51:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:52:07.476 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:52:07.476 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:52:07.476 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:52:07.477 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:52:07.477 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:52:07.477 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.477 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:52:07.477 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.477 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.477 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:52:07.477 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.477 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:52:07.477 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.477 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.477 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:52:07.477 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.477 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:52:07.477 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.478 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.478 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:52:07.478 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.478 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:52:07.478 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.478 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.478 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:52:07.478 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.478 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:52:07.478 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.478 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.478 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:52:07.478 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:52:07.478 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:52:07.478 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:52:07.479 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:52:07.479 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:52:07.479 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:52:07.479 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:52:07.479 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:52:07.479 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:52:07.479 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:52:07.479 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.479 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:52:07.479 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.479 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.479 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:52:07.479 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.479 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:52:07.479 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.480 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.481 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:52:07.481 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:52:07.481 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:52:07.481 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:52:07.481 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:52:07.481 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:52:07.481 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.481 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:52:07.481 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:52:07.481 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:52:07.481 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.481 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:52:07.481 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:52:07.481 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:52:07.481 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.482 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:52:07.482 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:52:07.482 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:52:07.482 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.482 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:52:07.482 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:52:07.482 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:52:07.482 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.482 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:52:07.482 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:52:07.482 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:52:07.482 INFO:tasks.workunit.client.0.smithi138.stdout:discard: 512~512 = 512 2024-09-22T03:52:07.482 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.482 INFO:tasks.workunit.client.0.smithi138.stdout:aio discard: 1536~512 = 0 2024-09-22T03:52:07.483 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:52:07.483 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:52:07.483 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:52:07.483 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:52:07.483 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:52:07.483 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 0 2024-09-22T03:52:07.483 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.483 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.483 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 0 2024-09-22T03:52:07.483 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.483 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.483 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 16384 2024-09-22T03:52:07.483 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.483 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.483 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 16384 2024-09-22T03:52:07.484 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.484 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.484 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:07.484 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:07.484 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 49152 2024-09-22T03:52:07.484 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.484 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.484 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 49152 2024-09-22T03:52:07.484 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.484 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.484 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 65536 2024-09-22T03:52:07.484 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.484 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.484 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 65536 2024-09-22T03:52:07.485 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.485 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.485 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:07.485 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:07.485 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 98304 2024-09-22T03:52:07.485 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.485 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.485 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 98304 2024-09-22T03:52:07.485 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.485 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.485 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 114688 2024-09-22T03:52:07.485 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.485 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.485 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 114688 2024-09-22T03:52:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 147456 2024-09-22T03:52:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 147456 2024-09-22T03:52:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 163840 2024-09-22T03:52:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 163840 2024-09-22T03:52:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 196608 2024-09-22T03:52:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 196608 2024-09-22T03:52:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 212992 2024-09-22T03:52:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 212992 2024-09-22T03:52:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:07.489 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.490 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.490 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.490 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:07.490 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:07.490 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.490 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:07.490 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:07.490 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.490 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:07.490 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.490 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.490 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:07.490 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.490 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.490 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:07.491 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:07.491 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:07.491 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:07.491 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:07.491 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:07.491 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:07.491 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.505 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.505 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:33.505 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:33.505 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:33.505 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:33.506 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:33.506 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.506 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.506 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:33.506 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:33.506 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:33.506 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:33.506 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:33.506 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.506 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.506 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:33.506 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.506 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.507 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:33.507 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.507 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.507 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:33.507 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:33.507 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:33.507 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:33.507 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:33.507 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.507 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.507 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:33.507 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:33.507 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:33.507 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:33.508 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:33.508 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.508 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.508 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:33.508 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:33.508 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:33.508 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:33.508 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:33.508 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.508 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.508 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:33.508 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:33.508 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:33.508 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:33.509 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:33.509 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.509 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.509 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:33.509 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.509 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.509 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:33.509 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.509 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.509 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:33.509 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:33.509 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:33.509 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:33.509 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:33.509 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.510 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.510 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:33.510 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:33.510 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:33.510 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:33.510 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:33.510 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.510 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.510 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:33.510 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:33.510 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:33.510 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:33.510 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:33.511 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.511 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.511 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:33.511 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:33.511 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:33.511 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:33.511 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:33.511 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.511 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.511 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:33.511 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.511 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.511 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:33.511 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.511 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.512 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:33.512 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:33.512 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:33.512 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:33.512 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:33.512 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.512 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.512 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:33.512 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:33.512 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:33.512 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:33.512 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:33.512 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.512 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.513 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:33.513 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:33.513 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:33.513 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:33.513 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:33.513 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.513 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.513 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:52:33.513 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:52:33.513 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:52:33.513 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:52:33.513 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:52:33.513 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.513 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.513 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:33.514 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:52:33.514 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:52:33.514 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:52:33.514 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:52:33.514 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:52:33.514 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:52:33.514 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:52:33.514 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 4 2024-09-22T03:52:33.514 INFO:tasks.workunit.client.0.smithi138.stdout:read: 4 2024-09-22T03:52:33.514 INFO:tasks.workunit.client.0.smithi138.stdout:read: 4 2024-09-22T03:52:33.514 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS1 (54827 ms) 2024-09-22T03:52:33.514 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS2 2024-09-22T03:52:33.515 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:53:07.625 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:53:07.625 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:53:07.626 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:53:07.626 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:53:07.626 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:53:07.626 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.626 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:53:07.626 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.626 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.626 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:53:07.626 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.626 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:53:07.626 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.626 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.626 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:53:07.627 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.627 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:53:07.627 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.627 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.627 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:53:07.627 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.627 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:53:07.627 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.627 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.627 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:53:07.627 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.627 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:53:07.627 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.627 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.628 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:53:07.628 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:53:07.628 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:53:07.628 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:53:07.628 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:53:07.628 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:53:07.628 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:53:07.628 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:53:07.628 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:53:07.628 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:53:07.628 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:53:07.628 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.628 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:53:07.628 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.629 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.629 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:53:07.629 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.629 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:53:07.629 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.629 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.629 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:53:07.629 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.629 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:53:07.629 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.629 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.629 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:53:07.629 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.629 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:53:07.629 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.630 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.630 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:53:07.630 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.630 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:53:07.630 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.630 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.630 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:53:07.630 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:53:07.630 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:53:07.630 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:53:07.630 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:53:07.630 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:53:07.630 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.630 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:53:07.631 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:53:07.631 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:53:07.631 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.631 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:53:07.631 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:53:07.631 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:53:07.631 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.631 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:53:07.631 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:53:07.631 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:53:07.631 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.631 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:53:07.631 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:53:07.631 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:53:07.631 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.632 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:53:07.632 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:53:07.632 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:53:07.632 INFO:tasks.workunit.client.0.smithi138.stdout:discard: 512~512 = 512 2024-09-22T03:53:07.632 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.632 INFO:tasks.workunit.client.0.smithi138.stdout:aio discard: 1536~512 = 0 2024-09-22T03:53:07.632 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:53:07.632 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:53:07.632 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:53:07.632 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:53:07.632 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:53:07.632 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 0 2024-09-22T03:53:07.632 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.632 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.632 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 0 2024-09-22T03:53:07.633 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.633 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.633 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 16384 2024-09-22T03:53:07.633 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.633 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.633 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 16384 2024-09-22T03:53:07.633 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.633 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.633 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:07.633 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:07.633 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 49152 2024-09-22T03:53:07.633 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.633 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.633 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 49152 2024-09-22T03:53:07.634 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.634 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.634 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 65536 2024-09-22T03:53:07.634 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.634 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.634 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 65536 2024-09-22T03:53:07.634 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.634 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.634 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:07.634 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:07.634 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 98304 2024-09-22T03:53:07.634 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.634 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.634 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 98304 2024-09-22T03:53:07.634 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 114688 2024-09-22T03:53:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 114688 2024-09-22T03:53:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 147456 2024-09-22T03:53:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 147456 2024-09-22T03:53:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.636 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.636 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 163840 2024-09-22T03:53:07.636 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.636 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.636 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 163840 2024-09-22T03:53:07.636 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.636 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.636 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:07.636 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:07.636 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 196608 2024-09-22T03:53:07.636 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.636 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.636 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 196608 2024-09-22T03:53:07.636 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.636 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.637 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 212992 2024-09-22T03:53:07.637 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.637 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.637 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 212992 2024-09-22T03:53:07.637 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.637 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.637 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:07.637 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:07.637 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.637 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:07.637 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.637 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.637 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:07.637 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.638 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.638 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.638 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:07.638 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.638 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.638 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:07.638 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.638 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.638 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.638 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:07.638 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.638 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.638 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:07.639 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.639 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.639 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.639 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:07.639 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.639 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.639 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:07.639 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.639 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.639 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.639 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:07.639 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:07.639 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.639 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:07.639 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:07.640 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.640 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:07.640 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.640 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.640 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:07.640 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.640 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.640 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:07.640 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:07.640 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:07.640 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:07.640 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:07.640 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:07.640 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:07.641 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.560 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.560 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:35.560 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:35.560 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:35.560 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:35.561 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:35.561 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.561 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.561 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:35.561 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:35.561 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:35.561 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:35.561 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:35.561 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.561 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.561 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:35.561 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.561 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.561 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:35.562 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.562 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.562 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:35.562 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:35.562 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:35.562 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:35.562 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:35.562 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.562 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.562 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:35.562 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:35.562 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:35.562 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:35.562 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:35.563 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.563 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.563 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:35.563 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:35.563 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:35.563 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:35.563 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:35.563 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.563 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.563 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:35.563 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:35.563 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:35.563 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:35.563 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:35.564 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.564 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.564 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:35.564 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.564 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.564 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:35.564 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.564 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.564 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:35.564 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:35.564 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:35.564 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:35.564 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:35.564 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.564 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.565 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:35.565 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:35.565 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:35.565 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:35.565 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:35.565 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.565 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.565 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:35.565 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:35.565 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:35.565 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:35.565 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:35.565 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.565 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.566 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:35.566 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:35.566 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:35.566 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:35.566 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:35.566 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.566 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.566 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:35.566 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.566 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.566 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:35.566 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.566 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.566 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:35.566 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:35.567 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:35.567 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:35.567 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:35.567 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.567 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.567 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:35.567 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:35.567 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:35.567 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:35.567 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:35.567 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.567 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.567 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:35.567 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:35.567 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:53:35.568 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 4 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:read: 4 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:read: 4 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS2 (62055 ms) 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCloneEncryption 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:2471: Skipped 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestCloneEncryption (0 ms) 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.LUKS1UnderLUKS2WithoutResize 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:2659: Skipped 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.LUKS1UnderLUKS2WithoutResize (0 ms) 2024-09-22T03:53:35.569 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.LUKS2UnderLUKS1WithoutResize 2024-09-22T03:53:35.570 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:2735: Skipped 2024-09-22T03:53:35.570 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:53:35.570 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.LUKS2UnderLUKS1WithoutResize (0 ms) 2024-09-22T03:53:35.570 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.EncryptionFormatNoData 2024-09-22T03:53:35.570 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:53:39.936 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.EncryptionFormatNoData (4377 ms) 2024-09-22T03:53:39.936 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadSize 2024-09-22T03:53:39.936 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:53:45.863 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.EncryptionLoadBadSize (5927 ms) 2024-09-22T03:53:45.864 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-22T03:53:45.864 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:2905: Skipped 2024-09-22T03:53:45.864 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:53:45.864 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern (0 ms) 2024-09-22T03:53:45.864 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.EncryptionLoadFormatMismatch 2024-09-22T03:53:45.864 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:2985: Skipped 2024-09-22T03:53:45.864 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:53:45.864 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadFormatMismatch (0 ms) 2024-09-22T03:53:45.864 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.EncryptedResize 2024-09-22T03:53:45.864 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:53:57.982 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.EncryptedResize (12118 ms) 2024-09-22T03:53:57.982 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.EncryptedFlattenSmallData 2024-09-22T03:53:57.982 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3202: Skipped 2024-09-22T03:53:57.982 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:53:57.982 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.EncryptedFlattenSmallData (0 ms) 2024-09-22T03:53:57.983 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestIOWithIOHint 2024-09-22T03:53:57.983 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:24.616 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:24.616 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:24.616 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:24.616 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:24.616 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:24.616 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.616 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:54:24.617 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.617 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.617 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:54:24.617 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.617 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:54:24.617 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.617 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.617 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:54:24.617 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.617 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:54:24.617 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.617 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.617 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:54:24.617 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.617 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:54:24.618 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.618 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.618 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:54:24.618 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.618 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:54:24.618 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.618 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.618 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:54:24.618 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:54:24.618 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:54:24.618 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:54:24.618 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:54:24.618 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:54:24.618 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:54:24.619 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:54:24.619 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:54:24.619 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:54:24.619 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:54:24.619 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.619 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:54:24.619 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.619 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.619 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:54:24.619 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.619 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:54:24.619 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.619 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.619 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:54:24.620 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.620 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:54:24.620 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.620 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.620 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:54:24.620 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.620 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:54:24.620 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.620 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.620 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:54:24.620 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.620 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:54:24.620 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.620 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.620 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:54:24.621 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:24.621 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:24.621 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:24.621 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:24.621 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:24.621 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.621 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:54:24.621 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:24.621 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:54:24.621 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.621 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:54:24.621 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:24.621 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:54:24.621 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.621 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:54:24.622 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:24.622 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:54:24.622 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.622 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:54:24.622 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:24.622 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:54:24.622 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.622 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:54:24.622 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:24.622 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:54:24.622 INFO:tasks.workunit.client.0.smithi138.stdout:discard: 512~512 = 512 2024-09-22T03:54:24.622 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.622 INFO:tasks.workunit.client.0.smithi138.stdout:aio discard: 1536~512 = 0 2024-09-22T03:54:24.622 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:24.622 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:24.623 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:24.623 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:24.623 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:24.623 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 0 2024-09-22T03:54:24.623 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.623 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.623 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 0 2024-09-22T03:54:24.623 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.623 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.623 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 16384 2024-09-22T03:54:24.623 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.623 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.623 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 16384 2024-09-22T03:54:24.623 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.623 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.624 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:24.624 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:24.624 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 49152 2024-09-22T03:54:24.624 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.624 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.624 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 49152 2024-09-22T03:54:24.624 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.624 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.624 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 65536 2024-09-22T03:54:24.624 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.624 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.624 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 65536 2024-09-22T03:54:24.624 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.624 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.624 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:24.625 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:24.625 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 98304 2024-09-22T03:54:24.625 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.625 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.625 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 98304 2024-09-22T03:54:24.625 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.625 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.625 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 114688 2024-09-22T03:54:24.625 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.625 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.625 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 114688 2024-09-22T03:54:24.625 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.625 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.625 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:24.626 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:24.626 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 147456 2024-09-22T03:54:24.626 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.626 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.626 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 147456 2024-09-22T03:54:24.626 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.626 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.626 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 163840 2024-09-22T03:54:24.626 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.626 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.626 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 163840 2024-09-22T03:54:24.626 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.626 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.626 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:24.627 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:24.627 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 196608 2024-09-22T03:54:24.627 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.627 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.627 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 196608 2024-09-22T03:54:24.627 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.627 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.627 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 212992 2024-09-22T03:54:24.627 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.627 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.627 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 212992 2024-09-22T03:54:24.627 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.627 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.627 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.628 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.629 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:24.629 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.629 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.629 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:24.629 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.629 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.629 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.629 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:24.629 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.629 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.629 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:24.629 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.629 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.629 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.629 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:24.630 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:24.630 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.630 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:24.630 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:24.630 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.630 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:24.630 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.630 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.630 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:24.630 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.630 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.630 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:24.630 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:24.630 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:24.631 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:24.631 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:24.631 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:24.631 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:24.631 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.689 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.689 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:47.689 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:47.690 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:47.690 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:47.690 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:47.690 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.690 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.690 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:47.690 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:47.690 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:47.690 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:47.690 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:47.690 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.690 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.690 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:47.690 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.690 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.691 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:47.691 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.691 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.691 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:47.691 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:47.691 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:47.691 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:47.691 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:47.691 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.691 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.691 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:47.691 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:47.691 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:47.691 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:47.691 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:47.692 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.692 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.692 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:47.692 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:47.692 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:47.692 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:47.692 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:47.692 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.692 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.692 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:47.692 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:47.692 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:47.692 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:47.692 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:47.693 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.693 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.693 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:47.693 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.693 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.693 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:47.693 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.693 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.693 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:47.693 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:47.693 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:47.693 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:47.693 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:47.693 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.693 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.697 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:47.697 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:47.697 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:54:47.697 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:54:47.697 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:54:47.697 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.697 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.697 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:47.698 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:47.698 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:54:47.698 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:54:47.698 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:47.698 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:47.698 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:47.698 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestIOWithIOHint (49708 ms) 2024-09-22T03:54:47.698 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestDataPoolIO 2024-09-22T03:54:47.698 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3947: Skipped 2024-09-22T03:54:47.698 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:54:47.698 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestDataPoolIO (0 ms) 2024-09-22T03:54:47.698 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatch 2024-09-22T03:54:47.698 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:47.815 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatch (126 ms) 2024-09-22T03:54:47.815 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatch 2024-09-22T03:54:47.815 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:47.953 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatch (138 ms) 2024-09-22T03:54:47.953 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccess 2024-09-22T03:54:47.953 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:48.084 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccess (130 ms) 2024-09-22T03:54:48.084 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccess 2024-09-22T03:54:48.084 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:48.214 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccess (130 ms) 2024-09-22T03:54:48.214 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned 2024-09-22T03:54:48.214 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:48.440 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned (226 ms) 2024-09-22T03:54:48.440 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned 2024-09-22T03:54:48.440 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:48.712 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned (272 ms) 2024-09-22T03:54:48.712 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLarge 2024-09-22T03:54:48.712 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:48.991 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLarge (279 ms) 2024-09-22T03:54:48.991 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLarge 2024-09-22T03:54:48.991 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:49.217 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLarge (227 ms) 2024-09-22T03:54:49.218 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess 2024-09-22T03:54:49.218 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:51.470 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess (2252 ms) 2024-09-22T03:54:51.470 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess 2024-09-22T03:54:51.470 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:53.802 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess (2332 ms) 2024-09-22T03:54:53.802 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers 2024-09-22T03:54:53.802 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:53.919 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers (117 ms) 2024-09-22T03:54:53.919 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVMismatch 2024-09-22T03:54:53.919 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:54.049 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVMismatch (130 ms) 2024-09-22T03:54:54.049 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVSuccess 2024-09-22T03:54:54.049 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:54.180 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVSuccess (132 ms) 2024-09-22T03:54:54.180 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestScatterGatherIO 2024-09-22T03:54:54.180 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:54.302 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestScatterGatherIO (121 ms) 2024-09-22T03:54:54.302 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestEmptyDiscard 2024-09-22T03:54:54.302 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:54.403 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:54.403 INFO:tasks.workunit.client.0.smithi138.stdout:aio discard: 0~1048576 = 0 2024-09-22T03:54:54.404 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:54.404 INFO:tasks.workunit.client.0.smithi138.stdout:aio discard: 0~4194304 = 0 2024-09-22T03:54:54.404 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:54.404 INFO:tasks.workunit.client.0.smithi138.stdout:aio discard: 3145728~1048576 = 0 2024-09-22T03:54:54.404 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestEmptyDiscard (101 ms) 2024-09-22T03:54:54.404 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestFUA 2024-09-22T03:54:54.404 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:54.842 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:54.842 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:54:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:54:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:54:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:54:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:54:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:54:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:54:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:54:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:54:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:54:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:54:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:54:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:54:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:54:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:54:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:54.846 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:54:54.846 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:54.846 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:54:54.846 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:54.846 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:54:54.846 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:54.846 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:54:54.846 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:54.846 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:54:54.846 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestFUA (440 ms) 2024-09-22T03:54:54.846 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestIOPP 2024-09-22T03:54:54.846 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:54:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:54:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:54:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:54:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:54:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:54:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:54:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:54:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:54:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:54:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:54:54.929 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:55.097 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:55.097 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:54:55.098 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:54:55.098 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:54:55.098 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:54:55.098 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:54:55.098 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:54:55.098 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:54:55.098 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:54:55.098 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:54:55.098 INFO:tasks.workunit.client.0.smithi138.stdout:start compare and write 2024-09-22T03:54:55.098 INFO:tasks.workunit.client.0.smithi138.stdout:compare and wrote: 512 2024-09-22T03:54:55.098 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:55.098 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:54:55.098 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:55.111 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:55.111 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:54:55.111 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:55.111 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:54:55.111 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:55.124 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:55.124 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:54:55.124 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:55.124 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:54:55.124 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:55.140 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:55.140 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:54:55.140 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:55.140 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:54:55.140 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:55.153 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:55.153 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:54:55.153 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:55.153 INFO:tasks.workunit.client.0.smithi138.stdout:started aio compare and write 2024-09-22T03:54:55.153 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:54:55.184 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:54:55.184 INFO:tasks.workunit.client.0.smithi138.stdout:finished aio compare and write 2024-09-22T03:54:55.184 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:55.184 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:55.184 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:55.184 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:55.184 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:54:55.184 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:55.184 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:54:55.185 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:55.188 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:54:55.188 INFO:tasks.workunit.client.0.smithi138.stdout:finished read 2024-09-22T03:54:55.188 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:55.188 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:54:55.188 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:55.192 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:54:55.192 INFO:tasks.workunit.client.0.smithi138.stdout:finished read 2024-09-22T03:54:55.192 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:55.192 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:54:55.192 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:55.196 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:54:55.196 INFO:tasks.workunit.client.0.smithi138.stdout:finished read 2024-09-22T03:54:55.196 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:55.196 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:54:55.196 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:55.200 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:54:55.200 INFO:tasks.workunit.client.0.smithi138.stdout:finished read 2024-09-22T03:54:55.200 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:54:55.200 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:54:55.200 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:54:55.200 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:54:55.200 INFO:tasks.workunit.client.0.smithi138.stdout:finished read 2024-09-22T03:54:55.201 INFO:tasks.workunit.client.0.smithi138.stdout:discard: 512~512 2024-09-22T03:54:55.201 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:13.221 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:55:13.221 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:55:13.221 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:55:13.221 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:55:13.221 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:55:13.221 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 0 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 0 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 16384 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 16384 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 49152 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.222 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.223 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 49152 2024-09-22T03:55:13.223 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.223 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.223 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 65536 2024-09-22T03:55:13.223 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.223 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.223 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 65536 2024-09-22T03:55:13.223 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.223 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.223 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:13.223 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:13.223 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 98304 2024-09-22T03:55:13.223 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.223 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 98304 2024-09-22T03:55:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 114688 2024-09-22T03:55:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 114688 2024-09-22T03:55:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 147456 2024-09-22T03:55:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 147456 2024-09-22T03:55:13.225 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.225 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.225 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 163840 2024-09-22T03:55:13.225 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.225 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.225 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 163840 2024-09-22T03:55:13.225 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.225 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.225 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:13.225 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:13.225 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 196608 2024-09-22T03:55:13.225 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.225 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.225 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 196608 2024-09-22T03:55:13.226 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.226 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.226 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 212992 2024-09-22T03:55:13.226 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.226 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.226 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 212992 2024-09-22T03:55:13.226 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.226 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.226 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:13.226 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:13.226 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:13.226 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:13.226 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:13.226 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:13.226 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:13.227 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.227 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.227 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:13.227 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:13.227 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:13.227 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:13.227 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:13.227 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.227 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.227 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:13.227 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:13.227 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:13.368 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:13.369 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:13.369 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.369 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.369 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:13.369 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:13.369 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:13.495 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:13.495 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:13.495 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.495 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.495 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:13.495 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:13.495 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:13.495 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:13.496 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:13.496 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:13.496 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:13.496 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:13.496 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:13.968 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:13.968 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:13.968 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:13.968 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:13.968 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:13.968 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:13.968 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:14.332 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:14.332 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:14.332 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:14.332 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:14.332 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:14.332 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:14.332 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:14.873 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:14.873 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:14.873 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:14.873 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:14.873 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:14.873 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:14.873 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:15.380 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:15.381 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:15.381 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:15.381 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:15.381 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:15.381 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:15.381 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:15.381 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:15.381 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:15.381 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:15.381 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:15.381 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:15.381 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:16.266 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:16.266 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:16.266 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:16.266 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:16.266 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:16.266 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:16.266 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:17.104 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:17.105 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:17.105 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:17.105 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:17.105 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:17.105 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:17.105 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:18.069 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:18.069 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:18.069 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:18.069 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:18.069 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:18.069 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:18.069 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:18.899 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:18.900 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:18.900 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:18.900 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:18.900 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:18.900 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:18.900 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:18.900 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:18.900 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:18.900 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:18.900 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:18.900 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:18.900 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:20.193 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:20.193 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:20.194 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:20.194 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:20.194 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:20.194 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:20.194 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:21.463 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:21.463 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:21.463 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:21.463 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:21.463 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:21.463 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:21.463 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:22.873 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:22.873 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:22.874 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:22.874 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:22.874 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:22.874 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:22.874 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:24.130 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:24.130 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:24.130 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:24.130 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:24.131 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:24.131 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:24.131 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:24.131 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:24.131 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:24.131 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:24.131 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:24.131 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:24.131 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:26.015 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:26.015 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:26.015 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:26.015 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:26.015 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:26.015 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:26.015 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:27.427 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:27.427 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:27.427 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:27.427 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:27.427 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:27.427 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:27.427 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:29.385 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:29.386 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:29.386 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:29.386 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:29.386 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:29.386 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:29.386 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:30.969 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:30.969 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:30.969 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:30.970 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:30.970 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:30.970 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:30.970 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:30.970 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:30.970 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:30.970 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:30.970 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestIOPP (36127 ms) 2024-09-22T03:55:30.970 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP 2024-09-22T03:55:30.970 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:31.085 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP (116 ms) 2024-09-22T03:55:31.086 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP 2024-09-22T03:55:31.086 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:31.200 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP (115 ms) 2024-09-22T03:55:31.201 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP 2024-09-22T03:55:31.201 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:31.308 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP (108 ms) 2024-09-22T03:55:31.308 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP 2024-09-22T03:55:31.308 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:31.433 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP (124 ms) 2024-09-22T03:55:31.433 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchPP 2024-09-22T03:55:31.433 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:31.561 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchPP (128 ms) 2024-09-22T03:55:31.561 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchPP 2024-09-22T03:55:31.561 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:31.721 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:31.750 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchPP (189 ms) 2024-09-22T03:55:31.750 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-22T03:55:31.750 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:31.879 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP (130 ms) 2024-09-22T03:55:31.880 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-22T03:55:31.880 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:31.982 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:32.008 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP (128 ms) 2024-09-22T03:55:32.008 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessPP 2024-09-22T03:55:32.008 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:32.144 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessPP (137 ms) 2024-09-22T03:55:32.144 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessPP 2024-09-22T03:55:32.144 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:32.245 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:32.269 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessPP (125 ms) 2024-09-22T03:55:32.269 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-22T03:55:32.269 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:32.414 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP (144 ms) 2024-09-22T03:55:32.414 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-22T03:55:32.414 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:32.534 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:32.562 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP (149 ms) 2024-09-22T03:55:32.562 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP 2024-09-22T03:55:32.562 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:32.833 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP (271 ms) 2024-09-22T03:55:32.834 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP 2024-09-22T03:55:32.834 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:33.019 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:33.081 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP (248 ms) 2024-09-22T03:55:33.081 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLargePP 2024-09-22T03:55:33.082 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:33.289 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLargePP (207 ms) 2024-09-22T03:55:33.289 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLargePP 2024-09-22T03:55:33.289 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:33.465 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:33.521 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLargePP (232 ms) 2024-09-22T03:55:33.521 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP 2024-09-22T03:55:33.521 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:35.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP (2255 ms) 2024-09-22T03:55:35.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP 2024-09-22T03:55:35.775 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:38.167 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:38.270 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP (2495 ms) 2024-09-22T03:55:38.270 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestIOPPWithIOHint 2024-09-22T03:55:38.270 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:55:38.423 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:55:38.424 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:55:38.424 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:55:38.424 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:55:38.424 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:55:38.424 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:38.424 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:55:38.424 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:38.435 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:38.436 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:55:38.436 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:38.436 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:55:38.436 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:38.448 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:38.448 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:55:38.448 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:38.448 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:55:38.448 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:38.460 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:38.460 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:55:38.460 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:38.460 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:55:38.460 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:38.473 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:38.473 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:55:38.473 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:38.473 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:55:38.473 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:38.485 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:38.485 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:55:38.485 INFO:tasks.workunit.client.0.smithi138.stdout:read: 512 2024-09-22T03:55:38.485 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:38.485 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:55:38.485 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:55:38.489 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:55:38.490 INFO:tasks.workunit.client.0.smithi138.stdout:finished read 2024-09-22T03:55:38.490 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:38.490 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:55:38.490 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:55:38.494 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:55:38.494 INFO:tasks.workunit.client.0.smithi138.stdout:finished read 2024-09-22T03:55:38.494 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:38.494 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:55:38.494 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:55:38.499 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:55:38.499 INFO:tasks.workunit.client.0.smithi138.stdout:finished read 2024-09-22T03:55:38.499 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:38.499 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:55:38.499 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:55:38.504 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:55:38.504 INFO:tasks.workunit.client.0.smithi138.stdout:finished read 2024-09-22T03:55:38.504 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:38.504 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:55:38.504 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:55:58.755 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:55:58.756 INFO:tasks.workunit.client.0.smithi138.stdout:finished read 2024-09-22T03:55:58.756 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 0 2024-09-22T03:55:58.756 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.756 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.756 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 0 2024-09-22T03:55:58.756 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.756 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.756 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 16384 2024-09-22T03:55:58.756 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.756 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.756 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 16384 2024-09-22T03:55:58.757 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.757 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.757 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:58.757 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:58.757 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 49152 2024-09-22T03:55:58.757 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.757 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.757 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 49152 2024-09-22T03:55:58.757 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.757 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.757 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 65536 2024-09-22T03:55:58.757 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.757 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.757 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 65536 2024-09-22T03:55:58.758 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.758 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.758 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:58.758 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:58.758 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 98304 2024-09-22T03:55:58.758 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.758 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.758 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 98304 2024-09-22T03:55:58.758 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.758 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.758 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 114688 2024-09-22T03:55:58.758 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.758 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.759 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 114688 2024-09-22T03:55:58.759 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.759 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.759 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:58.759 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:58.759 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 147456 2024-09-22T03:55:58.759 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.759 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.759 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 147456 2024-09-22T03:55:58.759 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.759 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.759 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 163840 2024-09-22T03:55:58.760 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.760 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.760 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 163840 2024-09-22T03:55:58.760 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.760 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.760 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:58.760 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:58.760 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 196608 2024-09-22T03:55:58.760 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.760 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.760 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 196608 2024-09-22T03:55:58.760 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.760 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.760 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 212992 2024-09-22T03:55:58.761 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.761 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.761 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 212992 2024-09-22T03:55:58.761 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.761 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.761 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:58.761 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:58.761 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:58.761 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:58.761 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:58.761 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:58.761 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:58.761 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.761 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.762 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:58.762 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:58.762 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:58.768 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:58.768 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:58.768 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.768 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.768 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:58.768 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:58.768 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:58.934 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:58.934 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:58.934 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:58.934 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:58.934 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:58.934 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:58.935 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:59.084 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:59.084 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:59.085 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:59.085 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:59.085 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:59.085 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:59.085 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:59.085 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:59.085 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:59.085 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:55:59.085 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:59.085 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:59.085 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:59.553 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:59.553 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:59.553 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:59.553 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:59.553 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:59.554 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:59.554 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:55:59.976 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:55:59.976 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:55:59.976 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:55:59.976 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:55:59.976 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:55:59.976 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:55:59.976 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:00.645 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:00.645 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:56:00.645 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:56:00.645 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:56:00.645 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:00.645 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:00.645 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:01.278 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:01.279 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:56:01.279 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:56:01.279 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:56:01.279 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:01.279 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:01.279 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:56:01.279 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:01.279 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:01.279 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:56:01.279 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:01.279 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:01.279 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:02.255 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:02.255 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:56:02.255 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:56:02.255 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:56:02.256 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:02.256 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:02.256 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:03.102 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:03.102 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:56:03.102 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:56:03.103 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:56:03.103 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:03.103 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:03.103 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:04.251 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:04.251 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:56:04.251 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:56:04.251 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:56:04.251 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:04.252 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:04.252 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:05.286 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:05.286 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:56:05.286 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:56:05.286 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:56:05.286 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:05.286 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:05.286 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:56:05.286 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:05.286 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:05.286 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:56:05.287 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:05.287 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:05.287 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:06.823 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:06.823 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:56:06.823 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:56:06.824 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:56:06.824 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:06.824 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:06.824 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:08.066 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:08.066 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:56:08.067 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:56:08.067 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:56:08.067 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:08.067 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:08.067 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:09.741 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:09.741 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:56:09.741 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:56:09.741 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:56:09.741 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:09.741 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:09.741 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:11.154 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:11.154 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:56:11.154 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:56:11.154 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:56:11.155 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:11.155 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:11.155 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:56:11.155 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:11.155 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:11.155 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:56:11.155 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:11.155 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:11.155 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:13.310 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:13.310 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:56:13.311 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:56:13.311 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:56:13.311 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:13.311 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:13.311 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:14.965 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:14.966 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:56:14.966 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:56:14.966 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:56:14.966 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:14.966 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:14.966 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:17.099 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:17.099 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:56:17.099 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:56:17.099 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:56:17.099 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:17.099 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:17.099 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:18.931 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:18.931 INFO:tasks.workunit.client.0.smithi138.stdout:finished writesame 2024-09-22T03:56:18.931 INFO:tasks.workunit.client.0.smithi138.stdout:to verify the data 2024-09-22T03:56:18.931 INFO:tasks.workunit.client.0.smithi138.stdout:verified 2024-09-22T03:56:18.932 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:18.932 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:18.932 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:56:18.932 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:18.932 INFO:tasks.workunit.client.0.smithi138.stdout:started writesame 2024-09-22T03:56:18.932 INFO:tasks.workunit.client.0.smithi138.stdout:expected fail, finished writesame 2024-09-22T03:56:18.932 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestIOPPWithIOHint (40661 ms) 2024-09-22T03:56:18.932 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestIOToSnapshot 2024-09-22T03:56:18.932 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:20.621 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 0 2024-09-22T03:56:20.621 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 0 2024-09-22T03:56:20.621 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 1 2024-09-22T03:56:20.621 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 1 2024-09-22T03:56:20.621 INFO:tasks.workunit.client.0.smithi138.stdout:snap: orig 2024-09-22T03:56:20.621 INFO:tasks.workunit.client.0.smithi138.stdout:found orig with size 2097152 2024-09-22T03:56:20.621 INFO:tasks.workunit.client.0.smithi138.stdout:read: 80 2024-09-22T03:56:20.622 INFO:tasks.workunit.client.0.smithi138.stdout:write test data! 2024-09-22T03:56:20.622 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 80 2024-09-22T03:56:20.622 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 2 2024-09-22T03:56:20.622 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 2 2024-09-22T03:56:20.622 INFO:tasks.workunit.client.0.smithi138.stdout:snap: orig 2024-09-22T03:56:20.622 INFO:tasks.workunit.client.0.smithi138.stdout:snap: written 2024-09-22T03:56:20.622 INFO:tasks.workunit.client.0.smithi138.stdout:found orig with size 2097152 2024-09-22T03:56:20.623 INFO:tasks.workunit.client.0.smithi138.stdout:found written with size 2097152 2024-09-22T03:56:20.623 INFO:tasks.workunit.client.0.smithi138.stdout:read: 80 2024-09-22T03:56:20.623 INFO:tasks.workunit.client.0.smithi138.stdout:read: 80 2024-09-22T03:56:20.623 INFO:tasks.workunit.client.0.smithi138.stdout:read: 80 2024-09-22T03:56:20.623 INFO:tasks.workunit.client.0.smithi138.stdout:write to snapshot returned -30 2024-09-22T03:56:20.623 INFO:tasks.workunit.client.0.smithi138.stdout:Read-only file system 2024-09-22T03:56:20.734 INFO:tasks.workunit.client.0.smithi138.stdout:read: 80 2024-09-22T03:56:20.735 INFO:tasks.workunit.client.0.smithi138.stdout:read: 80 2024-09-22T03:56:20.735 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 80 2024-09-22T03:56:20.735 INFO:tasks.workunit.client.0.smithi138.stdout:opening testimg@orig 2024-09-22T03:56:20.735 INFO:tasks.workunit.client.0.smithi138.stdout:read: 80 2024-09-22T03:56:20.735 INFO:tasks.workunit.client.0.smithi138.stdout:write to snapshot returned -30 2024-09-22T03:56:20.735 INFO:tasks.workunit.client.0.smithi138.stdout:Read-only file system 2024-09-22T03:56:22.613 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 2 2024-09-22T03:56:22.613 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 2 2024-09-22T03:56:22.613 INFO:tasks.workunit.client.0.smithi138.stdout:snap: orig 2024-09-22T03:56:22.613 INFO:tasks.workunit.client.0.smithi138.stdout:snap: written 2024-09-22T03:56:22.613 INFO:tasks.workunit.client.0.smithi138.stdout:found orig with size 2097152 2024-09-22T03:56:22.613 INFO:tasks.workunit.client.0.smithi138.stdout:found written with size 2097152 2024-09-22T03:56:22.613 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 1 2024-09-22T03:56:22.613 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 1 2024-09-22T03:56:22.613 INFO:tasks.workunit.client.0.smithi138.stdout:snap: orig 2024-09-22T03:56:22.613 INFO:tasks.workunit.client.0.smithi138.stdout:found orig with size 2097152 2024-09-22T03:56:22.613 INFO:tasks.workunit.client.0.smithi138.stdout:num snaps is: 0 2024-09-22T03:56:22.613 INFO:tasks.workunit.client.0.smithi138.stdout:expected: 0 2024-09-22T03:56:22.614 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestIOToSnapshot (3681 ms) 2024-09-22T03:56:22.614 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestSnapshotDeletedIo 2024-09-22T03:56:22.614 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:24.611 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestSnapshotDeletedIo (1998 ms) 2024-09-22T03:56:24.611 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestClone 2024-09-22T03:56:24.611 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:6444: Skipped 2024-09-22T03:56:24.611 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:24.611 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestClone (0 ms) 2024-09-22T03:56:24.611 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestClone2 2024-09-22T03:56:24.611 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:6608: Skipped 2024-09-22T03:56:24.612 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:24.612 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestClone2 (0 ms) 2024-09-22T03:56:24.612 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ListChildren 2024-09-22T03:56:24.612 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:6841: Skipped 2024-09-22T03:56:24.612 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:24.612 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ListChildren (0 ms) 2024-09-22T03:56:24.612 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ListChildrenTiered 2024-09-22T03:56:24.612 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:6995: Skipped 2024-09-22T03:56:24.612 INFO:tasks.workunit.client.0.smithi138.stdout:Not supported by crimson yet. Skipped 2024-09-22T03:56:24.612 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered (0 ms) 2024-09-22T03:56:24.612 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.LockingPP 2024-09-22T03:56:24.612 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:25.099 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.LockingPP (489 ms) 2024-09-22T03:56:25.100 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.FlushAio 2024-09-22T03:56:25.100 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:27.992 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.FlushAio (2893 ms) 2024-09-22T03:56:27.993 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.FlushAioPP 2024-09-22T03:56:27.993 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:30.861 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.FlushAioPP (2869 ms) 2024-09-22T03:56:30.861 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ZeroLengthWrite 2024-09-22T03:56:30.862 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:30.975 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.ZeroLengthWrite (114 ms) 2024-09-22T03:56:30.976 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ZeroLengthDiscard 2024-09-22T03:56:30.976 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:31.100 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.ZeroLengthDiscard (124 ms) 2024-09-22T03:56:31.151 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ZeroLengthRead 2024-09-22T03:56:31.151 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:31.216 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.ZeroLengthRead (116 ms) 2024-09-22T03:56:31.216 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.LargeCacheRead 2024-09-22T03:56:31.216 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:31.359 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.LargeCacheRead (143 ms) 2024-09-22T03:56:31.359 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestPendingAio 2024-09-22T03:56:31.359 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9152: Skipped 2024-09-22T03:56:31.359 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:31.359 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestPendingAio (0 ms) 2024-09-22T03:56:31.359 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyup 2024-09-22T03:56:31.359 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9264: Skipped 2024-09-22T03:56:31.359 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:31.359 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyup (0 ms) 2024-09-22T03:56:31.359 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-09-22T03:56:31.359 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9325: Skipped 2024-09-22T03:56:31.359 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:31.360 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyupMismatch (0 ms) 2024-09-22T03:56:31.360 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.Flatten 2024-09-22T03:56:31.360 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9336: Skipped 2024-09-22T03:56:31.360 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:31.360 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.Flatten (0 ms) 2024-09-22T03:56:31.360 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.Sparsify 2024-09-22T03:56:31.360 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:31.522 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 32768 2024-09-22T03:56:31.522 INFO:tasks.workunit.client.0.smithi138.stdout:read: 32768 2024-09-22T03:56:31.522 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.Sparsify (163 ms) 2024-09-22T03:56:31.522 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.SparsifyPP 2024-09-22T03:56:31.522 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:31.688 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.SparsifyPP (167 ms) 2024-09-22T03:56:31.688 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.SnapshotLimit 2024-09-22T03:56:31.688 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:36.661 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.SnapshotLimit (4972 ms) 2024-09-22T03:56:36.661 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.SnapshotLimitPP 2024-09-22T03:56:36.661 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:41.668 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.SnapshotLimitPP (5006 ms) 2024-09-22T03:56:41.669 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-09-22T03:56:41.669 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9523: Skipped 2024-09-22T03:56:41.669 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.669 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.RebuildObjectMapViaLockOwner (0 ms) 2024-09-22T03:56:41.669 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.RenameViaLockOwner 2024-09-22T03:56:41.669 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9575: Skipped 2024-09-22T03:56:41.669 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.669 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.RenameViaLockOwner (0 ms) 2024-09-22T03:56:41.669 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.SnapCreateViaLockOwner 2024-09-22T03:56:41.669 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9615: Skipped 2024-09-22T03:56:41.669 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.669 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SnapCreateViaLockOwner (0 ms) 2024-09-22T03:56:41.669 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.SnapRemoveViaLockOwner 2024-09-22T03:56:41.670 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9659: Skipped 2024-09-22T03:56:41.670 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.670 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveViaLockOwner (0 ms) 2024-09-22T03:56:41.670 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-09-22T03:56:41.670 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9699: Skipped 2024-09-22T03:56:41.670 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.670 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.UpdateFeaturesViaLockOwner (0 ms) 2024-09-22T03:56:41.670 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-22T03:56:41.670 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9736: Skipped 2024-09-22T03:56:41.670 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.670 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner (0 ms) 2024-09-22T03:56:41.670 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.SnapRemove2 2024-09-22T03:56:41.670 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9777: Skipped 2024-09-22T03:56:41.670 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.671 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SnapRemove2 (0 ms) 2024-09-22T03:56:41.671 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.SnapRenameViaLockOwner 2024-09-22T03:56:41.671 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9823: Skipped 2024-09-22T03:56:41.671 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.671 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SnapRenameViaLockOwner (0 ms) 2024-09-22T03:56:41.671 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.SnapProtectViaLockOwner 2024-09-22T03:56:41.671 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9864: Skipped 2024-09-22T03:56:41.671 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.671 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SnapProtectViaLockOwner (0 ms) 2024-09-22T03:56:41.671 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.SnapUnprotectViaLockOwner 2024-09-22T03:56:41.671 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9905: Skipped 2024-09-22T03:56:41.671 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.671 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SnapUnprotectViaLockOwner (0 ms) 2024-09-22T03:56:41.672 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.FlattenViaLockOwner 2024-09-22T03:56:41.672 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9949: Skipped 2024-09-22T03:56:41.672 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.672 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.FlattenViaLockOwner (0 ms) 2024-09-22T03:56:41.672 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ResizeViaLockOwner 2024-09-22T03:56:41.672 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:9997: Skipped 2024-09-22T03:56:41.672 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.672 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ResizeViaLockOwner (0 ms) 2024-09-22T03:56:41.672 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.SparsifyViaLockOwner 2024-09-22T03:56:41.672 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:10033: Skipped 2024-09-22T03:56:41.672 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.672 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SparsifyViaLockOwner (0 ms) 2024-09-22T03:56:41.672 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ObjectMapConsistentSnap 2024-09-22T03:56:41.673 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:10069: Skipped 2024-09-22T03:56:41.673 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.673 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ObjectMapConsistentSnap (0 ms) 2024-09-22T03:56:41.673 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.Metadata 2024-09-22T03:56:41.673 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:10121: Skipped 2024-09-22T03:56:41.673 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.673 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.Metadata (0 ms) 2024-09-22T03:56:41.673 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.MetadataPP 2024-09-22T03:56:41.673 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:10310: Skipped 2024-09-22T03:56:41.673 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.673 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.MetadataPP (0 ms) 2024-09-22T03:56:41.673 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.UpdateFeatures 2024-09-22T03:56:41.673 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:10391: Skipped 2024-09-22T03:56:41.673 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.674 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.UpdateFeatures (0 ms) 2024-09-22T03:56:41.674 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.FeaturesBitmaskString 2024-09-22T03:56:41.674 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.FeaturesBitmaskString (1 ms) 2024-09-22T03:56:41.674 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.RebuildObjectMap 2024-09-22T03:56:41.674 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:41.766 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.RebuildObjectMap (97 ms) 2024-09-22T03:56:41.766 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.RebuildNewObjectMap 2024-09-22T03:56:41.766 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:10584: Skipped 2024-09-22T03:56:41.766 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.766 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.RebuildNewObjectMap (0 ms) 2024-09-22T03:56:41.766 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.CheckObjectMap 2024-09-22T03:56:41.766 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:10609: Skipped 2024-09-22T03:56:41.767 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.767 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.CheckObjectMap (0 ms) 2024-09-22T03:56:41.767 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.BlockingAIO 2024-09-22T03:56:41.767 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:41.892 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.BlockingAIO (128 ms) 2024-09-22T03:56:41.892 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ExclusiveLockTransition 2024-09-22T03:56:41.893 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:10737: Skipped 2024-09-22T03:56:41.893 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.893 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockTransition (0 ms) 2024-09-22T03:56:41.893 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ExclusiveLockReadTransition 2024-09-22T03:56:41.893 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:10793: Skipped 2024-09-22T03:56:41.893 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.893 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition (0 ms) 2024-09-22T03:56:41.893 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.CacheMayCopyOnWrite 2024-09-22T03:56:41.893 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:10846: Skipped 2024-09-22T03:56:41.893 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:41.893 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.CacheMayCopyOnWrite (0 ms) 2024-09-22T03:56:41.893 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot 2024-09-22T03:56:41.893 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:42.706 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot (814 ms) 2024-09-22T03:56:42.706 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestImageOptions 2024-09-22T03:56:46.807 INFO:tasks.workunit.client.0.smithi138.stdout:0.00% done 2024-09-22T03:56:46.807 INFO:tasks.workunit.client.0.smithi138.stdout:100.00% done 2024-09-22T03:56:46.807 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestImageOptions (4101 ms) 2024-09-22T03:56:46.807 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestImageOptionsPP 2024-09-22T03:56:48.623 INFO:tasks.workunit.client.0.smithi138.stdout:0.00% done 2024-09-22T03:56:48.623 INFO:tasks.workunit.client.0.smithi138.stdout:100.00% done 2024-09-22T03:56:48.623 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestImageOptionsPP (1815 ms) 2024-09-22T03:56:48.623 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.EventSocketPipe 2024-09-22T03:56:48.623 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.EventSocketPipe (0 ms) 2024-09-22T03:56:48.623 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.EventSocketEventfd 2024-09-22T03:56:48.623 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.EventSocketEventfd (0 ms) 2024-09-22T03:56:48.623 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ImagePollIO 2024-09-22T03:56:48.623 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:48.980 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:56:48.980 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:56:48.981 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:56:48.981 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:56:48.981 INFO:tasks.workunit.client.0.smithi138.stdout:wrote: 512 2024-09-22T03:56:48.981 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:48.981 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:56:48.981 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:48.981 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:48.981 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:56:48.981 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:48.981 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:56:48.981 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:48.981 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:48.981 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:56:48.981 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:48.981 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:56:48.982 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:48.982 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:48.982 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:56:48.982 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:48.982 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:56:48.982 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:48.982 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:48.982 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:56:48.982 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:48.982 INFO:tasks.workunit.client.0.smithi138.stdout:started write 2024-09-22T03:56:48.982 INFO:tasks.workunit.client.0.smithi138.stdout:write completion cb called! 2024-09-22T03:56:48.982 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 0 2024-09-22T03:56:48.982 INFO:tasks.workunit.client.0.smithi138.stdout:finished write 2024-09-22T03:56:48.982 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:48.982 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:56:48.983 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:56:48.983 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:56:48.983 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:48.983 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:56:48.983 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:56:48.983 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:56:48.983 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:48.983 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:56:48.983 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:56:48.983 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:56:48.983 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:48.983 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:56:48.983 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:56:48.983 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:56:48.984 INFO:tasks.workunit.client.0.smithi138.stdout:created completion 2024-09-22T03:56:48.984 INFO:tasks.workunit.client.0.smithi138.stdout:started read 2024-09-22T03:56:48.984 INFO:tasks.workunit.client.0.smithi138.stdout:read completion cb called! 2024-09-22T03:56:48.984 INFO:tasks.workunit.client.0.smithi138.stdout:return value is: 512 2024-09-22T03:56:48.984 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.ImagePollIO (358 ms) 2024-09-22T03:56:48.984 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.Mirror 2024-09-22T03:56:49.047 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:49.085 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:49.423 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.Mirror (442 ms) 2024-09-22T03:56:49.423 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.MirrorPeerAttributes 2024-09-22T03:56:49.537 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.MirrorPeerAttributes (115 ms) 2024-09-22T03:56:49.537 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.CreateWithMirrorEnabled 2024-09-22T03:56:49.537 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:11322: Skipped 2024-09-22T03:56:49.538 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:49.538 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.CreateWithMirrorEnabled (0 ms) 2024-09-22T03:56:49.538 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-09-22T03:56:49.538 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:11364: Skipped 2024-09-22T03:56:49.538 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:49.538 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot (0 ms) 2024-09-22T03:56:49.538 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ExclusiveLock 2024-09-22T03:56:49.538 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:11410: Skipped 2024-09-22T03:56:49.538 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:49.538 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLock (0 ms) 2024-09-22T03:56:49.538 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.BreakLock 2024-09-22T03:56:49.538 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:11553: Skipped 2024-09-22T03:56:49.538 INFO:tasks.workunit.client.0.smithi138.stdout:Not supported by crimson yet. Skipped 2024-09-22T03:56:49.539 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.BreakLock (0 ms) 2024-09-22T03:56:49.539 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.DiscardAfterWrite 2024-09-22T03:56:49.539 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:49.634 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.DiscardAfterWrite (96 ms) 2024-09-22T03:56:49.634 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.DefaultFeatures 2024-09-22T03:56:49.635 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.DefaultFeatures (0 ms) 2024-09-22T03:56:49.635 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurge 2024-09-22T03:56:49.635 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:11676: Skipped 2024-09-22T03:56:49.635 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:49.635 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurge (0 ms) 2024-09-22T03:56:49.635 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-09-22T03:56:49.635 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:11722: Skipped 2024-09-22T03:56:49.635 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:49.635 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay (0 ms) 2024-09-22T03:56:49.635 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestTrashPurge 2024-09-22T03:56:49.635 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:11753: Skipped 2024-09-22T03:56:49.635 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:49.635 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestTrashPurge (0 ms) 2024-09-22T03:56:49.635 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndRestore 2024-09-22T03:56:49.636 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:11810: Skipped 2024-09-22T03:56:49.636 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:49.636 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndRestore (0 ms) 2024-09-22T03:56:49.636 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestListWatchers 2024-09-22T03:56:49.636 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:49.831 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestListWatchers (197 ms) 2024-09-22T03:56:49.831 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestSetSnapById 2024-09-22T03:56:49.831 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:50.699 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.TestSetSnapById (868 ms) 2024-09-22T03:56:50.699 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.Namespaces 2024-09-22T03:56:50.944 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.Namespaces (245 ms) 2024-09-22T03:56:50.944 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.NamespacesPP 2024-09-22T03:56:51.266 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:51.279 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.NamespacesPP (335 ms) 2024-09-22T03:56:51.279 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.Migration 2024-09-22T03:56:51.279 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:51.279 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:54.804 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.Migration (3525 ms) 2024-09-22T03:56:54.804 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.MigrationPP 2024-09-22T03:56:54.804 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:54.804 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:56:58.264 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.MigrationPP (3459 ms) 2024-09-22T03:56:58.264 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestGetAccessTimestamp 2024-09-22T03:56:58.264 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:12177: Skipped 2024-09-22T03:56:58.264 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:58.264 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestGetAccessTimestamp (0 ms) 2024-09-22T03:56:58.264 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.TestGetModifyTimestamp 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:12202: Skipped 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestGetModifyTimestamp (0 ms) 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ZeroOverlapFlatten 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:12225: Skipped 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ZeroOverlapFlatten (0 ms) 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.PoolMetadata 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:12258: Skipped 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.PoolMetadata (0 ms) 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.PoolMetadataPP 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:12370: Skipped 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.PoolMetadataPP (0 ms) 2024-09-22T03:56:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.Config 2024-09-22T03:56:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:12422: Skipped 2024-09-22T03:56:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.Config (0 ms) 2024-09-22T03:56:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ConfigPP 2024-09-22T03:56:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:12506: Skipped 2024-09-22T03:56:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ConfigPP (0 ms) 2024-09-22T03:56:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.PoolStatsPP 2024-09-22T03:56:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:12583: Skipped 2024-09-22T03:56:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.PoolStatsPP (0 ms) 2024-09-22T03:56:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ImageSpec 2024-09-22T03:56:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:12658: Skipped 2024-09-22T03:56:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ImageSpec (0 ms) 2024-09-22T03:56:58.267 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.SnapRemoveWithChildMissing 2024-09-22T03:56:58.267 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:12853: Skipped 2024-09-22T03:56:58.267 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:56:58.267 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveWithChildMissing (0 ms) 2024-09-22T03:56:58.267 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.QuiesceWatch 2024-09-22T03:56:58.267 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:57:04.641 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.QuiesceWatch (6378 ms) 2024-09-22T03:57:04.641 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.QuiesceWatchPP 2024-09-22T03:57:04.641 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:57:10.622 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.QuiesceWatchPP (5981 ms) 2024-09-22T03:57:10.622 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.QuiesceWatchError 2024-09-22T03:57:10.622 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:13115: Skipped 2024-09-22T03:57:10.622 INFO:tasks.workunit.client.0.smithi138.stdout:Not supported by crimson yet. Skipped 2024-09-22T03:57:10.622 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError (0 ms) 2024-09-22T03:57:10.622 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.QuiesceWatchTimeout 2024-09-22T03:57:10.622 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:57:10.697 INFO:tasks.workunit.client.0.smithi138.stderr:test quiesce is not long enough to time out 2024-09-22T03:57:19.515 INFO:tasks.workunit.client.0.smithi138.stderr:test quiesce is timed out 2024-09-22T03:57:19.533 INFO:tasks.workunit.client.0.smithi138.stderr:waiting for timed out ... 0 2024-09-22T03:57:20.534 INFO:tasks.workunit.client.0.smithi138.stderr:waiting for timed out ... 1 2024-09-22T03:57:21.534 INFO:tasks.workunit.client.0.smithi138.stderr:waiting for timed out ... 2 2024-09-22T03:57:22.534 INFO:tasks.workunit.client.0.smithi138.stderr:waiting for timed out ... 3 2024-09-22T03:57:23.534 INFO:tasks.workunit.client.0.smithi138.stderr:waiting for timed out ... 4 2024-09-22T03:57:24.534 INFO:tasks.workunit.client.0.smithi138.stderr:waiting for timed out ... 5 2024-09-22T03:57:25.534 INFO:tasks.workunit.client.0.smithi138.stderr:waiting for timed out ... 6 2024-09-22T03:57:26.534 INFO:tasks.workunit.client.0.smithi138.stderr:waiting for timed out ... 7 2024-09-22T03:57:27.534 INFO:tasks.workunit.client.0.smithi138.stderr:waiting for timed out ... 8 2024-09-22T03:57:28.535 INFO:tasks.workunit.client.0.smithi138.stderr:waiting for timed out ... 9 2024-09-22T03:57:29.535 INFO:tasks.workunit.client.0.smithi138.stderr:waiting for timed out ... 10 2024-09-22T03:57:40.535 INFO:tasks.workunit.client.0.smithi138.stderr:test retry succeeds 2024-09-22T03:57:43.670 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.QuiesceWatchTimeout (33048 ms) 2024-09-22T03:57:43.670 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.WriteZeroes 2024-09-22T03:57:43.670 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:57:43.867 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.WriteZeroes (197 ms) 2024-09-22T03:57:43.867 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.WriteZeroesThickProvision 2024-09-22T03:57:43.867 INFO:tasks.workunit.client.0.smithi138.stdout:using old format 2024-09-22T03:57:44.129 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestLibRBD.WriteZeroesThickProvision (262 ms) 2024-09-22T03:57:44.129 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.ConcurrentOperations 2024-09-22T03:57:44.129 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:13474: Skipped 2024-09-22T03:57:44.129 INFO:tasks.workunit.client.0.smithi138.stdout:Not supported by crimson yet. Skipped 2024-09-22T03:57:44.129 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations (0 ms) 2024-09-22T03:57:44.129 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestLibRBD.FormatAndCloneFormatOptions 2024-09-22T03:57:44.129 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:13630: Skipped 2024-09-22T03:57:44.129 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:44.129 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.FormatAndCloneFormatOptions (0 ms) 2024-09-22T03:57:50.400 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 171 tests from TestLibRBD (486466 ms total) 2024-09-22T03:57:50.400 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:57:50.400 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T03:57:50.400 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 171 tests from 1 test suite ran. (492783 ms total) 2024-09-22T03:57:50.400 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 104 tests. 2024-09-22T03:57:50.400 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 67 tests, listed below: 2024-09-22T03:57:50.400 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.CreateWithSameDataPool 2024-09-22T03:57:50.400 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestGetCreateTimestamp 2024-09-22T03:57:50.400 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.GetCreateTimestampPP 2024-09-22T03:57:50.400 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopy 2024-09-22T03:57:50.400 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopyPP 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestGetSnapShotTimeStamp 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryDataPool 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespace 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespaceDataPool 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestCloneEncryption 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.LUKS1UnderLUKS2WithoutResize 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.LUKS2UnderLUKS1WithoutResize 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadFormatMismatch 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.EncryptedFlattenSmallData 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestDataPoolIO 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestClone 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestClone2 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ListChildren 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered 2024-09-22T03:57:50.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestPendingAio 2024-09-22T03:57:50.402 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyup 2024-09-22T03:57:50.402 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-09-22T03:57:50.402 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.Flatten 2024-09-22T03:57:50.402 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-09-22T03:57:50.402 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.RenameViaLockOwner 2024-09-22T03:57:50.402 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SnapCreateViaLockOwner 2024-09-22T03:57:50.402 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveViaLockOwner 2024-09-22T03:57:50.402 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-09-22T03:57:50.402 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-22T03:57:50.402 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SnapRemove2 2024-09-22T03:57:50.402 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SnapRenameViaLockOwner 2024-09-22T03:57:50.402 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SnapProtectViaLockOwner 2024-09-22T03:57:50.402 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SnapUnprotectViaLockOwner 2024-09-22T03:57:50.402 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.FlattenViaLockOwner 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ResizeViaLockOwner 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SparsifyViaLockOwner 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ObjectMapConsistentSnap 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.Metadata 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.MetadataPP 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.UpdateFeatures 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.RebuildNewObjectMap 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.CheckObjectMap 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockTransition 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.CacheMayCopyOnWrite 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.CreateWithMirrorEnabled 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLock 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.BreakLock 2024-09-22T03:57:50.403 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurge 2024-09-22T03:57:50.404 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-09-22T03:57:50.404 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestTrashPurge 2024-09-22T03:57:50.404 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndRestore 2024-09-22T03:57:50.404 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestGetAccessTimestamp 2024-09-22T03:57:50.404 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.TestGetModifyTimestamp 2024-09-22T03:57:50.404 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ZeroOverlapFlatten 2024-09-22T03:57:50.404 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.PoolMetadata 2024-09-22T03:57:50.404 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.PoolMetadataPP 2024-09-22T03:57:50.404 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.Config 2024-09-22T03:57:50.404 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ConfigPP 2024-09-22T03:57:50.404 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.PoolStatsPP 2024-09-22T03:57:50.404 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ImageSpec 2024-09-22T03:57:50.404 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveWithChildMissing 2024-09-22T03:57:50.405 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError 2024-09-22T03:57:50.405 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations 2024-09-22T03:57:50.405 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestLibRBD.FormatAndCloneFormatOptions 2024-09-22T03:57:50.405 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:57:50.405 INFO:tasks.workunit.client.0.smithi138.stdout: YOU HAVE 1 DISABLED TEST 2024-09-22T03:57:50.405 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:57:50.474 INFO:tasks.workunit.client.0.smithi138.stdout:seed 32203 2024-09-22T03:57:50.475 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = EncryptedFlattenTest/0.* 2024-09-22T03:57:50.475 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-22T03:57:50.475 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T03:57:50.475 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/0, where TypeParam = PlaintextUnderLUKS1 2024-09-22T03:57:50.550 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/0.Simple 2024-09-22T03:57:52.410 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-22T03:57:52.410 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:52.410 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Simple (1860 ms) 2024-09-22T03:57:52.410 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/0.Grow 2024-09-22T03:57:52.410 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-22T03:57:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Grow (0 ms) 2024-09-22T03:57:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/0.Shrink 2024-09-22T03:57:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-22T03:57:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Shrink (0 ms) 2024-09-22T03:57:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOne 2024-09-22T03:57:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-22T03:57:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOne (0 ms) 2024-09-22T03:57:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot 2024-09-22T03:57:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-22T03:57:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot (0 ms) 2024-09-22T03:57:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/0.MinOverlap 2024-09-22T03:57:52.412 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-22T03:57:52.412 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:52.412 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/0.MinOverlap (0 ms) 2024-09-22T03:57:52.412 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/0.ZeroOverlap 2024-09-22T03:57:52.412 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-22T03:57:52.412 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:52.412 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ZeroOverlap (0 ms) 2024-09-22T03:57:53.419 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/0 (1860 ms total) 2024-09-22T03:57:53.419 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:57:53.419 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T03:57:53.420 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 7 tests from 1 test suite ran. (2945 ms total) 2024-09-22T03:57:53.420 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 0 tests. 2024-09-22T03:57:53.420 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-22T03:57:53.420 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Simple 2024-09-22T03:57:53.420 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Grow 2024-09-22T03:57:53.420 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Shrink 2024-09-22T03:57:53.420 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOne 2024-09-22T03:57:53.420 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot 2024-09-22T03:57:53.420 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/0.MinOverlap 2024-09-22T03:57:53.420 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ZeroOverlap 2024-09-22T03:57:53.507 INFO:tasks.workunit.client.0.smithi138.stdout:seed 32267 2024-09-22T03:57:53.507 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = EncryptedFlattenTest/1.* 2024-09-22T03:57:53.507 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-22T03:57:53.507 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T03:57:53.508 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/1, where TypeParam = PlaintextUnderLUKS2 2024-09-22T03:57:53.588 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/1.Simple 2024-09-22T03:57:55.424 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-22T03:57:55.424 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:55.424 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Simple (1836 ms) 2024-09-22T03:57:55.424 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/1.Grow 2024-09-22T03:57:55.424 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Grow (0 ms) 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/1.Shrink 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Shrink (0 ms) 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOne 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOne (0 ms) 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot (0 ms) 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/1.MinOverlap 2024-09-22T03:57:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-22T03:57:55.426 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:55.426 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/1.MinOverlap (0 ms) 2024-09-22T03:57:55.426 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/1.ZeroOverlap 2024-09-22T03:57:55.426 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-22T03:57:55.426 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:55.426 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ZeroOverlap (0 ms) 2024-09-22T03:57:56.434 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/1 (1836 ms total) 2024-09-22T03:57:56.434 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:57:56.434 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T03:57:56.434 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 7 tests from 1 test suite ran. (2926 ms total) 2024-09-22T03:57:56.434 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 0 tests. 2024-09-22T03:57:56.434 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-22T03:57:56.434 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Simple 2024-09-22T03:57:56.434 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Grow 2024-09-22T03:57:56.434 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Shrink 2024-09-22T03:57:56.434 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOne 2024-09-22T03:57:56.434 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot 2024-09-22T03:57:56.435 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/1.MinOverlap 2024-09-22T03:57:56.435 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ZeroOverlap 2024-09-22T03:57:56.528 INFO:tasks.workunit.client.0.smithi138.stdout:seed 32331 2024-09-22T03:57:56.529 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = EncryptedFlattenTest/2.* 2024-09-22T03:57:56.529 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-22T03:57:56.529 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T03:57:56.529 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/2, where TypeParam = UnformattedLUKS1 2024-09-22T03:57:56.609 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/2.Simple 2024-09-22T03:57:58.264 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-22T03:57:58.264 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Simple (1655 ms) 2024-09-22T03:57:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/2.Grow 2024-09-22T03:57:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-22T03:57:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Grow (1 ms) 2024-09-22T03:57:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/2.Shrink 2024-09-22T03:57:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-22T03:57:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Shrink (0 ms) 2024-09-22T03:57:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOne 2024-09-22T03:57:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-22T03:57:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOne (0 ms) 2024-09-22T03:57:58.265 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot 2024-09-22T03:57:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-22T03:57:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot (0 ms) 2024-09-22T03:57:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/2.MinOverlap 2024-09-22T03:57:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-22T03:57:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/2.MinOverlap (0 ms) 2024-09-22T03:57:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/2.ZeroOverlap 2024-09-22T03:57:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-22T03:57:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:57:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ZeroOverlap (0 ms) 2024-09-22T03:57:59.268 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/2 (1656 ms total) 2024-09-22T03:57:59.268 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:57:59.268 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T03:57:59.268 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 7 tests from 1 test suite ran. (2738 ms total) 2024-09-22T03:57:59.268 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 0 tests. 2024-09-22T03:57:59.268 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-22T03:57:59.268 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Simple 2024-09-22T03:57:59.268 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Grow 2024-09-22T03:57:59.268 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Shrink 2024-09-22T03:57:59.269 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOne 2024-09-22T03:57:59.269 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot 2024-09-22T03:57:59.269 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/2.MinOverlap 2024-09-22T03:57:59.269 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ZeroOverlap 2024-09-22T03:57:59.369 INFO:tasks.workunit.client.0.smithi138.stdout:seed 32395 2024-09-22T03:57:59.369 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = EncryptedFlattenTest/3.* 2024-09-22T03:57:59.370 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-22T03:57:59.370 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T03:57:59.370 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/3, where TypeParam = LUKS1UnderLUKS1 2024-09-22T03:57:59.449 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/3.Simple 2024-09-22T03:58:01.456 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-22T03:58:01.456 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:01.456 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Simple (2006 ms) 2024-09-22T03:58:01.456 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/3.Grow 2024-09-22T03:58:01.456 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-22T03:58:01.456 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:01.456 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Grow (0 ms) 2024-09-22T03:58:01.457 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/3.Shrink 2024-09-22T03:58:01.457 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-22T03:58:01.457 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:01.457 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Shrink (0 ms) 2024-09-22T03:58:01.457 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOne 2024-09-22T03:58:01.457 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-22T03:58:01.457 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:01.457 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOne (0 ms) 2024-09-22T03:58:01.457 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot 2024-09-22T03:58:01.457 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-22T03:58:01.457 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:01.457 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot (0 ms) 2024-09-22T03:58:01.457 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/3.MinOverlap 2024-09-22T03:58:01.458 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-22T03:58:01.458 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:01.458 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/3.MinOverlap (0 ms) 2024-09-22T03:58:01.458 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/3.ZeroOverlap 2024-09-22T03:58:01.458 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-22T03:58:01.458 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:01.458 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ZeroOverlap (0 ms) 2024-09-22T03:58:02.460 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/3 (2007 ms total) 2024-09-22T03:58:02.460 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:58:02.460 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T03:58:02.460 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 7 tests from 1 test suite ran. (3090 ms total) 2024-09-22T03:58:02.460 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 0 tests. 2024-09-22T03:58:02.460 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-22T03:58:02.460 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Simple 2024-09-22T03:58:02.460 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Grow 2024-09-22T03:58:02.460 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Shrink 2024-09-22T03:58:02.460 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOne 2024-09-22T03:58:02.460 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot 2024-09-22T03:58:02.460 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/3.MinOverlap 2024-09-22T03:58:02.460 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ZeroOverlap 2024-09-22T03:58:02.561 INFO:tasks.workunit.client.0.smithi138.stdout:seed 32459 2024-09-22T03:58:02.561 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = EncryptedFlattenTest/4.* 2024-09-22T03:58:02.561 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-22T03:58:02.561 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T03:58:02.561 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/4, where TypeParam = LUKS1UnderLUKS2 2024-09-22T03:58:02.643 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/4.Simple 2024-09-22T03:58:04.469 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-22T03:58:04.470 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:04.470 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Simple (1823 ms) 2024-09-22T03:58:04.470 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/4.Grow 2024-09-22T03:58:04.470 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-22T03:58:04.470 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:04.470 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Grow (0 ms) 2024-09-22T03:58:04.470 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/4.Shrink 2024-09-22T03:58:04.470 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-22T03:58:04.470 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:04.470 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Shrink (0 ms) 2024-09-22T03:58:04.470 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOne 2024-09-22T03:58:04.470 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-22T03:58:04.471 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:04.471 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOne (0 ms) 2024-09-22T03:58:04.471 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot 2024-09-22T03:58:04.471 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-22T03:58:04.471 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:04.471 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot (0 ms) 2024-09-22T03:58:04.471 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/4.MinOverlap 2024-09-22T03:58:04.471 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-22T03:58:04.471 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:04.471 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/4.MinOverlap (0 ms) 2024-09-22T03:58:04.471 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/4.ZeroOverlap 2024-09-22T03:58:04.471 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-22T03:58:04.471 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:04.472 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ZeroOverlap (0 ms) 2024-09-22T03:58:05.471 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/4 (1823 ms total) 2024-09-22T03:58:05.471 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:58:05.471 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T03:58:05.471 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 7 tests from 1 test suite ran. (2909 ms total) 2024-09-22T03:58:05.471 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 0 tests. 2024-09-22T03:58:05.471 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-22T03:58:05.471 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Simple 2024-09-22T03:58:05.471 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Grow 2024-09-22T03:58:05.472 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Shrink 2024-09-22T03:58:05.472 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOne 2024-09-22T03:58:05.472 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot 2024-09-22T03:58:05.472 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/4.MinOverlap 2024-09-22T03:58:05.472 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ZeroOverlap 2024-09-22T03:58:05.564 INFO:tasks.workunit.client.0.smithi138.stdout:seed 32523 2024-09-22T03:58:05.565 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = EncryptedFlattenTest/5.* 2024-09-22T03:58:05.565 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-22T03:58:05.565 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T03:58:05.565 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/5, where TypeParam = UnformattedLUKS2 2024-09-22T03:58:05.653 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/5.Simple 2024-09-22T03:58:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-22T03:58:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Simple (1833 ms) 2024-09-22T03:58:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/5.Grow 2024-09-22T03:58:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-22T03:58:07.486 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Grow (0 ms) 2024-09-22T03:58:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/5.Shrink 2024-09-22T03:58:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-22T03:58:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Shrink (0 ms) 2024-09-22T03:58:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOne 2024-09-22T03:58:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-22T03:58:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOne (0 ms) 2024-09-22T03:58:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot 2024-09-22T03:58:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-22T03:58:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot (0 ms) 2024-09-22T03:58:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/5.MinOverlap 2024-09-22T03:58:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-22T03:58:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/5.MinOverlap (0 ms) 2024-09-22T03:58:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/5.ZeroOverlap 2024-09-22T03:58:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-22T03:58:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:07.488 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ZeroOverlap (0 ms) 2024-09-22T03:58:08.489 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/5 (1833 ms total) 2024-09-22T03:58:08.489 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:58:08.489 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T03:58:08.489 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 7 tests from 1 test suite ran. (2924 ms total) 2024-09-22T03:58:08.489 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 0 tests. 2024-09-22T03:58:08.489 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-22T03:58:08.490 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Simple 2024-09-22T03:58:08.490 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Grow 2024-09-22T03:58:08.490 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Shrink 2024-09-22T03:58:08.490 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOne 2024-09-22T03:58:08.490 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot 2024-09-22T03:58:08.490 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/5.MinOverlap 2024-09-22T03:58:08.490 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ZeroOverlap 2024-09-22T03:58:08.595 INFO:tasks.workunit.client.0.smithi138.stdout:seed 32587 2024-09-22T03:58:08.596 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = EncryptedFlattenTest/6.* 2024-09-22T03:58:08.596 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-22T03:58:08.596 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T03:58:08.596 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/6, where TypeParam = LUKS2UnderLUKS2 2024-09-22T03:58:08.677 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/6.Simple 2024-09-22T03:58:10.500 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-22T03:58:10.500 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:10.500 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Simple (1822 ms) 2024-09-22T03:58:10.500 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/6.Grow 2024-09-22T03:58:10.500 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-22T03:58:10.500 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:10.500 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Grow (0 ms) 2024-09-22T03:58:10.500 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/6.Shrink 2024-09-22T03:58:10.500 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-22T03:58:10.501 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:10.501 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Shrink (0 ms) 2024-09-22T03:58:10.501 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOne 2024-09-22T03:58:10.501 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-22T03:58:10.501 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:10.501 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOne (0 ms) 2024-09-22T03:58:10.501 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot 2024-09-22T03:58:10.501 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-22T03:58:10.501 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:10.501 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot (0 ms) 2024-09-22T03:58:10.501 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/6.MinOverlap 2024-09-22T03:58:10.501 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-22T03:58:10.501 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:10.502 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/6.MinOverlap (0 ms) 2024-09-22T03:58:10.502 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/6.ZeroOverlap 2024-09-22T03:58:10.502 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-22T03:58:10.502 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:10.502 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ZeroOverlap (0 ms) 2024-09-22T03:58:11.501 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/6 (1822 ms total) 2024-09-22T03:58:11.501 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:58:11.501 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T03:58:11.501 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 7 tests from 1 test suite ran. (2905 ms total) 2024-09-22T03:58:11.501 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 0 tests. 2024-09-22T03:58:11.501 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-22T03:58:11.501 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Simple 2024-09-22T03:58:11.501 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Grow 2024-09-22T03:58:11.502 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Shrink 2024-09-22T03:58:11.502 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOne 2024-09-22T03:58:11.502 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot 2024-09-22T03:58:11.502 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/6.MinOverlap 2024-09-22T03:58:11.502 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ZeroOverlap 2024-09-22T03:58:11.580 INFO:tasks.workunit.client.0.smithi138.stdout:seed 32651 2024-09-22T03:58:11.580 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = EncryptedFlattenTest/7.* 2024-09-22T03:58:11.580 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-22T03:58:11.581 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T03:58:11.581 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/7, where TypeParam = LUKS2UnderLUKS1 2024-09-22T03:58:11.674 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/7.Simple 2024-09-22T03:58:13.267 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-22T03:58:13.267 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:13.267 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Simple (1593 ms) 2024-09-22T03:58:13.268 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/7.Grow 2024-09-22T03:58:13.268 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-22T03:58:13.268 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:13.268 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Grow (1 ms) 2024-09-22T03:58:13.268 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/7.Shrink 2024-09-22T03:58:13.268 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-22T03:58:13.268 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:13.268 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Shrink (0 ms) 2024-09-22T03:58:13.268 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOne 2024-09-22T03:58:13.268 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-22T03:58:13.268 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:13.268 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOne (0 ms) 2024-09-22T03:58:13.268 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot 2024-09-22T03:58:13.268 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-22T03:58:13.268 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:13.269 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot (0 ms) 2024-09-22T03:58:13.269 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/7.MinOverlap 2024-09-22T03:58:13.269 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-22T03:58:13.269 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:13.269 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/7.MinOverlap (0 ms) 2024-09-22T03:58:13.269 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] EncryptedFlattenTest/7.ZeroOverlap 2024-09-22T03:58:13.269 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-22T03:58:13.269 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:13.269 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ZeroOverlap (0 ms) 2024-09-22T03:58:14.274 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 7 tests from EncryptedFlattenTest/7 (1594 ms total) 2024-09-22T03:58:14.274 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:58:14.275 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T03:58:14.275 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 7 tests from 1 test suite ran. (2694 ms total) 2024-09-22T03:58:14.275 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 0 tests. 2024-09-22T03:58:14.275 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-22T03:58:14.275 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Simple 2024-09-22T03:58:14.275 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Grow 2024-09-22T03:58:14.275 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Shrink 2024-09-22T03:58:14.275 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOne 2024-09-22T03:58:14.275 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot 2024-09-22T03:58:14.275 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/7.MinOverlap 2024-09-22T03:58:14.275 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ZeroOverlap 2024-09-22T03:58:14.375 INFO:tasks.workunit.client.0.smithi138.stdout:seed 32715 2024-09-22T03:58:14.375 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = TestImageWatcher.* 2024-09-22T03:58:14.375 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-22T03:58:14.375 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T03:58:14.375 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 17 tests from TestImageWatcher 2024-09-22T03:58:16.286 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifyHeaderUpdate 2024-09-22T03:58:18.344 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:460: Skipped 2024-09-22T03:58:18.344 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.344 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyHeaderUpdate (2058 ms) 2024-09-22T03:58:18.344 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifyFlatten 2024-09-22T03:58:18.380 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:478: Skipped 2024-09-22T03:58:18.380 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.380 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyFlatten (36 ms) 2024-09-22T03:58:18.380 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifyResize 2024-09-22T03:58:18.416 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:512: Skipped 2024-09-22T03:58:18.416 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.416 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyResize (37 ms) 2024-09-22T03:58:18.416 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifyRebuildObjectMap 2024-09-22T03:58:18.452 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:546: Skipped 2024-09-22T03:58:18.452 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.452 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyRebuildObjectMap (36 ms) 2024-09-22T03:58:18.453 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifyUpdateFeatures 2024-09-22T03:58:18.490 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:581: Skipped 2024-09-22T03:58:18.491 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.491 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyUpdateFeatures (38 ms) 2024-09-22T03:58:18.491 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifySnapCreate 2024-09-22T03:58:18.528 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:611: Skipped 2024-09-22T03:58:18.528 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.528 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreate (37 ms) 2024-09-22T03:58:18.528 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifySnapCreateError 2024-09-22T03:58:18.569 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:646: Skipped 2024-09-22T03:58:18.569 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.569 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreateError (41 ms) 2024-09-22T03:58:18.569 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifySnapRename 2024-09-22T03:58:18.607 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:670: Skipped 2024-09-22T03:58:18.607 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.607 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRename (39 ms) 2024-09-22T03:58:18.607 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifySnapRenameError 2024-09-22T03:58:18.644 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:701: Skipped 2024-09-22T03:58:18.644 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.644 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRenameError (37 ms) 2024-09-22T03:58:18.644 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifySnapRemove 2024-09-22T03:58:18.680 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:723: Skipped 2024-09-22T03:58:18.680 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.680 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRemove (36 ms) 2024-09-22T03:58:18.681 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifySnapProtect 2024-09-22T03:58:18.717 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:754: Skipped 2024-09-22T03:58:18.718 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.718 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapProtect (37 ms) 2024-09-22T03:58:18.718 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifySnapUnprotect 2024-09-22T03:58:18.755 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:785: Skipped 2024-09-22T03:58:18.756 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.756 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapUnprotect (38 ms) 2024-09-22T03:58:18.756 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifyRename 2024-09-22T03:58:18.792 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:816: Skipped 2024-09-22T03:58:18.793 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.793 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyRename (37 ms) 2024-09-22T03:58:18.793 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifyAsyncTimedOut 2024-09-22T03:58:18.830 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:847: Skipped 2024-09-22T03:58:18.830 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.830 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncTimedOut (38 ms) 2024-09-22T03:58:18.830 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifyAsyncError 2024-09-22T03:58:18.870 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:867: Skipped 2024-09-22T03:58:18.871 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.871 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncError (40 ms) 2024-09-22T03:58:18.871 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifyAsyncCompleteError 2024-09-22T03:58:18.910 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:887: Skipped 2024-09-22T03:58:18.910 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.911 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncCompleteError (40 ms) 2024-09-22T03:58:18.911 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-09-22T03:58:18.947 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ImageWatcher.cc:918: Skipped 2024-09-22T03:58:18.948 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:18.948 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncRequestTimedOut (37 ms) 2024-09-22T03:58:19.301 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 17 tests from TestImageWatcher (2662 ms total) 2024-09-22T03:58:19.301 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:58:19.301 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T03:58:19.301 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 17 tests from 1 test suite ran. (4925 ms total) 2024-09-22T03:58:19.301 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 0 tests. 2024-09-22T03:58:19.301 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 17 tests, listed below: 2024-09-22T03:58:19.301 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyHeaderUpdate 2024-09-22T03:58:19.301 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyFlatten 2024-09-22T03:58:19.301 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyResize 2024-09-22T03:58:19.301 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyRebuildObjectMap 2024-09-22T03:58:19.301 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyUpdateFeatures 2024-09-22T03:58:19.301 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreate 2024-09-22T03:58:19.301 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreateError 2024-09-22T03:58:19.302 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRename 2024-09-22T03:58:19.302 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRenameError 2024-09-22T03:58:19.302 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRemove 2024-09-22T03:58:19.302 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapProtect 2024-09-22T03:58:19.302 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapUnprotect 2024-09-22T03:58:19.302 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyRename 2024-09-22T03:58:19.302 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncTimedOut 2024-09-22T03:58:19.302 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncError 2024-09-22T03:58:19.302 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncCompleteError 2024-09-22T03:58:19.302 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-09-22T03:58:19.414 INFO:tasks.workunit.client.0.smithi138.stdout:seed 32764 2024-09-22T03:58:19.416 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = TestInternal.* 2024-09-22T03:58:19.416 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 34 tests from 1 test suite. 2024-09-22T03:58:19.416 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T03:58:19.416 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 34 tests from TestInternal 2024-09-22T03:58:21.310 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.OpenByID 2024-09-22T03:58:23.406 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:176: Skipped 2024-09-22T03:58:23.406 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:23.406 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.OpenByID (2095 ms) 2024-09-22T03:58:23.406 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.OpenSnapDNE 2024-09-22T03:58:23.520 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestInternal.OpenSnapDNE (115 ms) 2024-09-22T03:58:23.521 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.IsExclusiveLockOwner 2024-09-22T03:58:23.597 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:198: Skipped 2024-09-22T03:58:23.598 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:23.598 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.IsExclusiveLockOwner (77 ms) 2024-09-22T03:58:23.598 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.ResizeLocksImage 2024-09-22T03:58:23.635 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:218: Skipped 2024-09-22T03:58:23.635 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:23.635 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.ResizeLocksImage (38 ms) 2024-09-22T03:58:23.635 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.ResizeFailsToLockImage 2024-09-22T03:58:23.672 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:232: Skipped 2024-09-22T03:58:23.672 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:23.672 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.ResizeFailsToLockImage (36 ms) 2024-09-22T03:58:23.672 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.SnapCreateLocksImage 2024-09-22T03:58:23.709 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:243: Skipped 2024-09-22T03:58:23.709 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:23.709 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapCreateLocksImage (38 ms) 2024-09-22T03:58:23.709 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.SnapCreateFailsToLockImage 2024-09-22T03:58:23.746 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:261: Skipped 2024-09-22T03:58:23.746 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:23.746 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapCreateFailsToLockImage (36 ms) 2024-09-22T03:58:23.746 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.SnapRollbackLocksImage 2024-09-22T03:58:23.785 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:271: Skipped 2024-09-22T03:58:23.785 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:23.785 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapRollbackLocksImage (39 ms) 2024-09-22T03:58:23.785 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.SnapRollbackFailsToLockImage 2024-09-22T03:58:23.823 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:289: Skipped 2024-09-22T03:58:23.823 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:23.823 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapRollbackFailsToLockImage (38 ms) 2024-09-22T03:58:23.823 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.SnapSetReleasesLock 2024-09-22T03:58:23.861 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:306: Skipped 2024-09-22T03:58:23.862 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:23.862 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapSetReleasesLock (39 ms) 2024-09-22T03:58:23.862 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.FlattenLocksImage 2024-09-22T03:58:23.899 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:321: Skipped 2024-09-22T03:58:23.899 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:23.899 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.FlattenLocksImage (38 ms) 2024-09-22T03:58:23.900 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.FlattenFailsToLockImage 2024-09-22T03:58:23.935 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:348: Skipped 2024-09-22T03:58:23.936 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:23.936 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.FlattenFailsToLockImage (36 ms) 2024-09-22T03:58:23.936 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-22T03:58:23.973 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:382: Skipped 2024-09-22T03:58:23.974 INFO:tasks.workunit.client.0.smithi138.stdout:Not supported by crimson yet. Skipped 2024-09-22T03:58:23.974 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted (38 ms) 2024-09-22T03:58:23.974 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-22T03:58:24.011 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:416: Skipped 2024-09-22T03:58:24.011 INFO:tasks.workunit.client.0.smithi138.stdout:Not supported by crimson yet. Skipped 2024-09-22T03:58:24.011 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch (38 ms) 2024-09-22T03:58:24.011 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.AioWriteRequestsLock 2024-09-22T03:58:24.053 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:455: Skipped 2024-09-22T03:58:24.053 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:24.054 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.AioWriteRequestsLock (42 ms) 2024-09-22T03:58:24.054 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.AioDiscardRequestsLock 2024-09-22T03:58:24.093 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:481: Skipped 2024-09-22T03:58:24.093 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:24.093 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.AioDiscardRequestsLock (40 ms) 2024-09-22T03:58:24.093 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.CancelAsyncResize 2024-09-22T03:58:24.131 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:503: Skipped 2024-09-22T03:58:24.131 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:24.131 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.CancelAsyncResize (38 ms) 2024-09-22T03:58:24.131 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.MultipleResize 2024-09-22T03:58:24.531 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestInternal.MultipleResize (399 ms) 2024-09-22T03:58:24.531 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.Metadata 2024-09-22T03:58:24.571 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:592: Skipped 2024-09-22T03:58:24.571 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:24.571 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.Metadata (40 ms) 2024-09-22T03:58:24.571 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.MetadataConfApply 2024-09-22T03:58:24.608 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:639: Skipped 2024-09-22T03:58:24.608 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:24.608 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.MetadataConfApply (37 ms) 2024-09-22T03:58:24.608 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.SnapshotCopyup 2024-09-22T03:58:24.645 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:662: Skipped 2024-09-22T03:58:24.645 INFO:tasks.workunit.client.0.smithi138.stdout:Not supported by crimson yet. Skipped 2024-09-22T03:58:24.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup (38 ms) 2024-09-22T03:58:24.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.SnapshotCopyupZeros 2024-09-22T03:58:24.693 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:814: Skipped 2024-09-22T03:58:24.693 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:24.693 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZeros (47 ms) 2024-09-22T03:58:24.693 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.SnapshotCopyupZerosMigration 2024-09-22T03:58:24.730 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:902: Skipped 2024-09-22T03:58:24.731 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:24.731 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZerosMigration (38 ms) 2024-09-22T03:58:24.731 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.ResizeCopyup 2024-09-22T03:58:24.768 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:987: Skipped 2024-09-22T03:58:24.769 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:24.769 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.ResizeCopyup (38 ms) 2024-09-22T03:58:24.769 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.DiscardCopyup 2024-09-22T03:58:24.807 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:1052: Skipped 2024-09-22T03:58:24.807 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:24.807 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.DiscardCopyup (38 ms) 2024-09-22T03:58:24.807 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.ImageOptions 2024-09-22T03:58:24.845 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestInternal.ImageOptions (39 ms) 2024-09-22T03:58:24.845 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.WriteFullCopyup 2024-09-22T03:58:24.882 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:1183: Skipped 2024-09-22T03:58:24.882 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:24.883 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.WriteFullCopyup (37 ms) 2024-09-22T03:58:24.883 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.DiffIterateCloneOverwrite 2024-09-22T03:58:24.920 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:1257: Skipped 2024-09-22T03:58:24.920 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:24.920 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.DiffIterateCloneOverwrite (38 ms) 2024-09-22T03:58:24.921 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.TestCoR 2024-09-22T03:58:24.959 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:1307: Skipped 2024-09-22T03:58:24.959 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:24.959 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.TestCoR (39 ms) 2024-09-22T03:58:24.960 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.FlattenNoEmptyObjects 2024-09-22T03:58:24.997 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:1455: Skipped 2024-09-22T03:58:24.997 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:24.997 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.FlattenNoEmptyObjects (37 ms) 2024-09-22T03:58:24.997 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.PoolMetadataConfApply 2024-09-22T03:58:25.036 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:1574: Skipped 2024-09-22T03:58:25.036 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:25.036 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.PoolMetadataConfApply (39 ms) 2024-09-22T03:58:25.036 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.Sparsify 2024-09-22T03:58:25.198 INFO:tasks.workunit.client.0.smithi138.stdout:sparsify_supported=1 2024-09-22T03:58:25.198 INFO:tasks.workunit.client.0.smithi138.stdout:sparse_read_supported=1 2024-09-22T03:58:25.435 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestInternal.Sparsify (399 ms) 2024-09-22T03:58:25.435 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.SparsifyClone 2024-09-22T03:58:25.474 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:1737: Skipped 2024-09-22T03:58:25.475 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:25.475 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SparsifyClone (39 ms) 2024-09-22T03:58:25.475 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestInternal.MissingDataPool 2024-09-22T03:58:25.512 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_internal.cc:1800: Skipped 2024-09-22T03:58:25.512 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:25.512 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.MissingDataPool (37 ms) 2024-09-22T03:58:26.340 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 34 tests from TestInternal (4201 ms total) 2024-09-22T03:58:26.340 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:58:26.340 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T03:58:26.340 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 34 tests from 1 test suite ran. (6925 ms total) 2024-09-22T03:58:26.340 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 4 tests. 2024-09-22T03:58:26.340 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 30 tests, listed below: 2024-09-22T03:58:26.340 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.OpenByID 2024-09-22T03:58:26.340 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.IsExclusiveLockOwner 2024-09-22T03:58:26.340 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.ResizeLocksImage 2024-09-22T03:58:26.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.ResizeFailsToLockImage 2024-09-22T03:58:26.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapCreateLocksImage 2024-09-22T03:58:26.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapCreateFailsToLockImage 2024-09-22T03:58:26.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapRollbackLocksImage 2024-09-22T03:58:26.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapRollbackFailsToLockImage 2024-09-22T03:58:26.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapSetReleasesLock 2024-09-22T03:58:26.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.FlattenLocksImage 2024-09-22T03:58:26.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.FlattenFailsToLockImage 2024-09-22T03:58:26.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-22T03:58:26.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-22T03:58:26.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.AioWriteRequestsLock 2024-09-22T03:58:26.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.AioDiscardRequestsLock 2024-09-22T03:58:26.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.CancelAsyncResize 2024-09-22T03:58:26.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.Metadata 2024-09-22T03:58:26.342 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.MetadataConfApply 2024-09-22T03:58:26.342 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup 2024-09-22T03:58:26.342 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZeros 2024-09-22T03:58:26.342 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZerosMigration 2024-09-22T03:58:26.342 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.ResizeCopyup 2024-09-22T03:58:26.342 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.DiscardCopyup 2024-09-22T03:58:26.342 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.WriteFullCopyup 2024-09-22T03:58:26.342 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.DiffIterateCloneOverwrite 2024-09-22T03:58:26.342 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.TestCoR 2024-09-22T03:58:26.342 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.FlattenNoEmptyObjects 2024-09-22T03:58:26.342 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.PoolMetadataConfApply 2024-09-22T03:58:26.342 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.SparsifyClone 2024-09-22T03:58:26.342 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestInternal.MissingDataPool 2024-09-22T03:58:26.444 INFO:tasks.workunit.client.0.smithi138.stdout:seed 32816 2024-09-22T03:58:26.445 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = TestMirroring.* 2024-09-22T03:58:26.445 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 51 tests from 1 test suite. 2024-09-22T03:58:26.445 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T03:58:26.445 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 51 tests from TestMirroring 2024-09-22T03:58:28.269 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage 2024-09-22T03:58:31.640 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage (3372 ms) 2024-09-22T03:58:31.640 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool 2024-09-22T03:58:33.058 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool (1418 ms) 2024-09-22T03:58:33.058 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled 2024-09-22T03:58:34.104 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled (1045 ms) 2024-09-22T03:58:34.104 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage 2024-09-22T03:58:35.475 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage (1371 ms) 2024-09-22T03:58:35.475 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap 2024-09-22T03:58:36.777 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap (1303 ms) 2024-09-22T03:58:36.777 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModePool 2024-09-22T03:58:38.061 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModePool (1284 ms) 2024-09-22T03:58:38.061 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled 2024-09-22T03:58:39.526 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled (1465 ms) 2024-09-22T03:58:39.527 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.DisableImageMirrorWithPeer 2024-09-22T03:58:39.527 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_mirroring.cc:482: Skipped 2024-09-22T03:58:39.527 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:39.527 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer (0 ms) 2024-09-22T03:58:39.527 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.DisableJournalingWithPeer 2024-09-22T03:58:39.527 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_mirroring.cc:520: Skipped 2024-09-22T03:58:39.527 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:58:39.527 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer (0 ms) 2024-09-22T03:58:39.527 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling 2024-09-22T03:58:40.426 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling (900 ms) 2024-09-22T03:58:40.427 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling 2024-09-22T03:58:41.432 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling (1006 ms) 2024-09-22T03:58:41.432 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling 2024-09-22T03:58:43.758 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling (2324 ms) 2024-09-22T03:58:43.758 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock 2024-09-22T03:58:45.769 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock (2013 ms) 2024-09-22T03:58:45.769 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeDisabled 2024-09-22T03:58:46.905 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeDisabled (1136 ms) 2024-09-22T03:58:46.906 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage 2024-09-22T03:58:48.090 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage (1185 ms) 2024-09-22T03:58:48.090 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool 2024-09-22T03:58:49.419 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool (1329 ms) 2024-09-22T03:58:49.419 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling 2024-09-22T03:58:50.494 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling (1074 ms) 2024-09-22T03:58:50.494 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling 2024-09-22T03:58:51.530 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling (1036 ms) 2024-09-22T03:58:51.530 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeDisabled 2024-09-22T03:58:52.802 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeDisabled (1273 ms) 2024-09-22T03:58:52.803 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage 2024-09-22T03:58:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage (1293 ms) 2024-09-22T03:58:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled 2024-09-22T03:58:56.050 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled (1955 ms) 2024-09-22T03:58:56.050 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModePool 2024-09-22T03:58:57.482 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModePool (1431 ms) 2024-09-22T03:58:57.482 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModePool 2024-09-22T03:58:58.838 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModePool (1357 ms) 2024-09-22T03:58:58.838 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModeImage 2024-09-22T03:59:00.170 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModeImage (1331 ms) 2024-09-22T03:59:00.170 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode 2024-09-22T03:59:02.198 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode (2029 ms) 2024-09-22T03:59:02.198 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode 2024-09-22T03:59:04.166 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode (1967 ms) 2024-09-22T03:59:04.166 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode 2024-09-22T03:59:05.891 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode (1726 ms) 2024-09-22T03:59:05.892 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode 2024-09-22T03:59:07.764 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode (1873 ms) 2024-09-22T03:59:07.764 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode 2024-09-22T03:59:09.731 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode (1966 ms) 2024-09-22T03:59:09.731 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode 2024-09-22T03:59:11.932 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode (2201 ms) 2024-09-22T03:59:11.932 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageEnabled 2024-09-22T03:59:12.992 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageEnabled (1061 ms) 2024-09-22T03:59:12.993 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDisabled 2024-09-22T03:59:13.962 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDisabled (970 ms) 2024-09-22T03:59:13.962 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.RemoveImage_With_ImageWithoutJournal 2024-09-22T03:59:14.788 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.RemoveImage_With_ImageWithoutJournal (825 ms) 2024-09-22T03:59:14.788 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDemoted 2024-09-22T03:59:16.497 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDemoted (1709 ms) 2024-09-22T03:59:16.497 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.TrashMoveRestore_PoolMode 2024-09-22T03:59:18.134 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.TrashMoveRestore_PoolMode (1638 ms) 2024-09-22T03:59:18.134 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled 2024-09-22T03:59:19.468 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled (1334 ms) 2024-09-22T03:59:19.469 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled 2024-09-22T03:59:20.944 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled (1475 ms) 2024-09-22T03:59:20.944 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.MirrorStatusList 2024-09-22T03:59:21.890 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.MirrorStatusList (947 ms) 2024-09-22T03:59:21.890 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.RemoveBootstrapped 2024-09-22T03:59:23.065 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.RemoveBootstrapped (1174 ms) 2024-09-22T03:59:23.065 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.AioPromoteDemote 2024-09-22T03:59:29.061 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.AioPromoteDemote (5996 ms) 2024-09-22T03:59:29.061 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.AioGetInfo 2024-09-22T03:59:33.613 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.AioGetInfo (4553 ms) 2024-09-22T03:59:33.614 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.AioGetStatus 2024-09-22T03:59:36.419 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.AioGetStatus (2806 ms) 2024-09-22T03:59:36.419 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.SiteName 2024-09-22T03:59:36.427 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.SiteName (7 ms) 2024-09-22T03:59:36.427 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.Bootstrap 2024-09-22T03:59:48.392 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.Bootstrap (11965 ms) 2024-09-22T03:59:48.392 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.PeerDirection 2024-09-22T03:59:48.475 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroring.PeerDirection (83 ms) 2024-09-22T03:59:48.476 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.Snapshot 2024-09-22T03:59:48.476 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_mirroring.cc:1109: Skipped 2024-09-22T03:59:48.476 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:59:48.476 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.Snapshot (0 ms) 2024-09-22T03:59:48.476 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.SnapshotRemoveOnDisable 2024-09-22T03:59:48.476 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_mirroring.cc:1188: Skipped 2024-09-22T03:59:48.476 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:59:48.476 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.SnapshotRemoveOnDisable (1 ms) 2024-09-22T03:59:48.476 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.SnapshotUnlinkPeer 2024-09-22T03:59:48.476 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_mirroring.cc:1226: Skipped 2024-09-22T03:59:48.476 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:59:48.476 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.SnapshotUnlinkPeer (0 ms) 2024-09-22T03:59:48.476 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.SnapshotImageState 2024-09-22T03:59:48.476 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_mirroring.cc:1339: Skipped 2024-09-22T03:59:48.477 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:59:48.477 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.SnapshotImageState (0 ms) 2024-09-22T03:59:48.477 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.SnapshotPromoteDemote 2024-09-22T03:59:48.477 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_mirroring.cc:1449: Skipped 2024-09-22T03:59:48.477 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:59:48.477 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.SnapshotPromoteDemote (0 ms) 2024-09-22T03:59:48.477 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroring.AioSnapshotCreate 2024-09-22T03:59:48.477 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_mirroring.cc:1484: Skipped 2024-09-22T03:59:48.477 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:59:48.477 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.AioSnapshotCreate (0 ms) 2024-09-22T03:59:49.458 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 51 tests from TestMirroring (80207 ms total) 2024-09-22T03:59:49.459 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:59:49.459 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T03:59:49.459 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 51 tests from 1 test suite ran. (83014 ms total) 2024-09-22T03:59:49.459 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 43 tests. 2024-09-22T03:59:49.459 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-22T03:59:49.459 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer 2024-09-22T03:59:49.459 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer 2024-09-22T03:59:49.459 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.Snapshot 2024-09-22T03:59:49.459 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.SnapshotRemoveOnDisable 2024-09-22T03:59:49.459 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.SnapshotUnlinkPeer 2024-09-22T03:59:49.459 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.SnapshotImageState 2024-09-22T03:59:49.459 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.SnapshotPromoteDemote 2024-09-22T03:59:49.459 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestMirroring.AioSnapshotCreate 2024-09-22T03:59:49.583 INFO:tasks.workunit.client.0.smithi138.stdout:seed 33320 2024-09-22T03:59:49.583 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = TestGroup.* 2024-09-22T03:59:49.583 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-22T03:59:49.583 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T03:59:49.583 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 13 tests from TestGroup 2024-09-22T03:59:51.461 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestGroup.group_create 2024-09-22T03:59:53.632 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestGroup.group_create (2170 ms) 2024-09-22T03:59:53.632 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestGroup.group_createPP 2024-09-22T03:59:53.776 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestGroup.group_createPP (145 ms) 2024-09-22T03:59:53.776 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestGroup.group_get_id 2024-09-22T03:59:53.891 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestGroup.group_get_id (115 ms) 2024-09-22T03:59:53.891 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestGroup.group_get_idPP 2024-09-22T03:59:54.004 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestGroup.group_get_idPP (113 ms) 2024-09-22T03:59:54.004 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestGroup.add_image 2024-09-22T03:59:54.042 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_Groups.cc:113: Skipped 2024-09-22T03:59:54.042 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:59:54.042 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.add_image (38 ms) 2024-09-22T03:59:54.042 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestGroup.add_imagePP 2024-09-22T03:59:54.079 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_Groups.cc:195: Skipped 2024-09-22T03:59:54.079 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:59:54.079 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.add_imagePP (36 ms) 2024-09-22T03:59:54.079 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestGroup.add_snapshot 2024-09-22T03:59:54.114 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_Groups.cc:260: Skipped 2024-09-22T03:59:54.115 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:59:54.115 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.add_snapshot (36 ms) 2024-09-22T03:59:54.115 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestGroup.add_snapshotPP 2024-09-22T03:59:54.150 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_Groups.cc:413: Skipped 2024-09-22T03:59:54.151 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:59:54.151 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.add_snapshotPP (36 ms) 2024-09-22T03:59:54.151 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestGroup.snap_get_info 2024-09-22T03:59:54.187 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_Groups.cc:498: Skipped 2024-09-22T03:59:54.187 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:59:54.187 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.snap_get_info (37 ms) 2024-09-22T03:59:54.188 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestGroup.snap_get_infoPP 2024-09-22T03:59:54.223 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_Groups.cc:553: Skipped 2024-09-22T03:59:54.223 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:59:54.223 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.snap_get_infoPP (36 ms) 2024-09-22T03:59:54.223 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestGroup.snap_list2 2024-09-22T03:59:54.258 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_Groups.cc:601: Skipped 2024-09-22T03:59:54.258 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:59:54.259 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.snap_list2 (35 ms) 2024-09-22T03:59:54.259 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestGroup.snap_list2PP 2024-09-22T03:59:54.294 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_Groups.cc:700: Skipped 2024-09-22T03:59:54.294 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:59:54.295 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.snap_list2PP (36 ms) 2024-09-22T03:59:54.295 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestGroup.snap_list_internal 2024-09-22T03:59:54.331 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_Groups.cc:781: Skipped 2024-09-22T03:59:54.331 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T03:59:54.331 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.snap_list_internal (36 ms) 2024-09-22T03:59:54.485 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 13 tests from TestGroup (2869 ms total) 2024-09-22T03:59:54.485 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:59:54.485 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T03:59:54.485 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 13 tests from 1 test suite ran. (4901 ms total) 2024-09-22T03:59:54.485 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 4 tests. 2024-09-22T03:59:54.485 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 9 tests, listed below: 2024-09-22T03:59:54.485 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.add_image 2024-09-22T03:59:54.485 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.add_imagePP 2024-09-22T03:59:54.485 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.add_snapshot 2024-09-22T03:59:54.485 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.add_snapshotPP 2024-09-22T03:59:54.486 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.snap_get_info 2024-09-22T03:59:54.486 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.snap_get_infoPP 2024-09-22T03:59:54.486 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.snap_list2 2024-09-22T03:59:54.486 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.snap_list2PP 2024-09-22T03:59:54.486 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestGroup.snap_list_internal 2024-09-22T03:59:54.589 INFO:tasks.workunit.client.0.smithi138.stdout:seed 33369 2024-09-22T03:59:54.589 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = TestMirroringWatcher.* 2024-09-22T03:59:54.589 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-22T03:59:54.589 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T03:59:54.589 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 2 tests from TestMirroringWatcher 2024-09-22T03:59:56.491 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroringWatcher.ModeUpdated 2024-09-22T03:59:58.443 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroringWatcher.ModeUpdated (1952 ms) 2024-09-22T03:59:58.443 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestMirroringWatcher.ImageStatusUpdated 2024-09-22T03:59:58.565 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestMirroringWatcher.ImageStatusUpdated (122 ms) 2024-09-22T03:59:59.507 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 2 tests from TestMirroringWatcher (2074 ms total) 2024-09-22T03:59:59.507 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T03:59:59.507 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T03:59:59.507 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 2 tests from 1 test suite ran. (4918 ms total) 2024-09-22T03:59:59.507 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 2 tests. 2024-09-22T03:59:59.604 INFO:tasks.workunit.client.0.smithi138.stdout:seed 33421 2024-09-22T03:59:59.605 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = TestObjectMap.* 2024-09-22T03:59:59.605 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-22T03:59:59.605 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T03:59:59.605 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from TestObjectMap 2024-09-22T04:00:01.522 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-09-22T04:00:03.606 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ObjectMap.cc:38: Skipped 2024-09-22T04:00:03.606 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:03.606 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenCorrupt (2085 ms) 2024-09-22T04:00:03.607 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-09-22T04:00:03.642 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ObjectMap.cc:66: Skipped 2024-09-22T04:00:03.642 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:03.642 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenTooSmall (35 ms) 2024-09-22T04:00:03.642 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestObjectMap.InvalidateFlagOnDisk 2024-09-22T04:00:03.679 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ObjectMap.cc:95: Skipped 2024-09-22T04:00:03.679 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:03.680 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestObjectMap.InvalidateFlagOnDisk (38 ms) 2024-09-22T04:00:03.680 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-09-22T04:00:03.716 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_ObjectMap.cc:128: Skipped 2024-09-22T04:00:03.717 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:03.717 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall (37 ms) 2024-09-22T04:00:04.535 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from TestObjectMap (2195 ms total) 2024-09-22T04:00:04.535 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T04:00:04.535 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T04:00:04.535 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 4 tests from 1 test suite ran. (4930 ms total) 2024-09-22T04:00:04.535 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 0 tests. 2024-09-22T04:00:04.535 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-22T04:00:04.535 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-09-22T04:00:04.535 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-09-22T04:00:04.535 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestObjectMap.InvalidateFlagOnDisk 2024-09-22T04:00:04.536 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-09-22T04:00:04.536 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T04:00:04.536 INFO:tasks.workunit.client.0.smithi138.stdout: YOU HAVE 1 DISABLED TEST 2024-09-22T04:00:04.536 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T04:00:04.628 INFO:tasks.workunit.client.0.smithi138.stdout:seed 33470 2024-09-22T04:00:04.629 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = TestOperations.* 2024-09-22T04:00:04.629 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 1 test from 1 test suite. 2024-09-22T04:00:04.629 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T04:00:04.629 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 1 test from TestOperations 2024-09-22T04:00:06.541 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestOperations.DisableJournalingCorrupt 2024-09-22T04:00:08.355 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_Operations.cc:18: Skipped 2024-09-22T04:00:08.356 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:08.356 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt (1814 ms) 2024-09-22T04:00:09.285 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 1 test from TestOperations (1814 ms total) 2024-09-22T04:00:09.285 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T04:00:09.285 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T04:00:09.285 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 1 test from 1 test suite ran. (4655 ms total) 2024-09-22T04:00:09.285 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 0 tests. 2024-09-22T04:00:09.285 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-22T04:00:09.285 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt 2024-09-22T04:00:09.374 INFO:tasks.workunit.client.0.smithi138.stdout:seed 33519 2024-09-22T04:00:09.375 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = TestTrash.* 2024-09-22T04:00:09.375 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-22T04:00:09.375 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T04:00:09.375 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 2 tests from TestTrash 2024-09-22T04:00:11.290 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestTrash.UserRemovingSource 2024-09-22T04:00:13.371 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_Trash.cc:36: Skipped 2024-09-22T04:00:13.371 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:13.371 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestTrash.UserRemovingSource (2080 ms) 2024-09-22T04:00:13.371 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestTrash.RestoreMirroringSource 2024-09-22T04:00:13.406 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/test_Trash.cc:93: Skipped 2024-09-22T04:00:13.406 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:13.406 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestTrash.RestoreMirroringSource (36 ms) 2024-09-22T04:00:14.317 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 2 tests from TestTrash (2116 ms total) 2024-09-22T04:00:14.318 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T04:00:14.318 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T04:00:14.318 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 2 tests from 1 test suite ran. (4943 ms total) 2024-09-22T04:00:14.318 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 0 tests. 2024-09-22T04:00:14.318 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-22T04:00:14.318 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestTrash.UserRemovingSource 2024-09-22T04:00:14.318 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestTrash.RestoreMirroringSource 2024-09-22T04:00:14.425 INFO:tasks.workunit.client.0.smithi138.stdout:seed 33568 2024-09-22T04:00:14.426 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = TestJournalEntries.* 2024-09-22T04:00:14.426 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-22T04:00:14.426 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T04:00:14.426 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from TestJournalEntries 2024-09-22T04:00:16.319 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalEntries.AioWrite 2024-09-22T04:00:18.365 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Entries.cc:118: Skipped 2024-09-22T04:00:18.365 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:18.365 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalEntries.AioWrite (2046 ms) 2024-09-22T04:00:18.365 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalEntries.AioDiscard 2024-09-22T04:00:18.400 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Entries.cc:163: Skipped 2024-09-22T04:00:18.400 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:18.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard (36 ms) 2024-09-22T04:00:18.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalEntries.AioDiscardWithPrune 2024-09-22T04:00:18.440 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Entries.cc:200: Skipped 2024-09-22T04:00:18.440 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:18.440 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune (39 ms) 2024-09-22T04:00:18.440 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalEntries.AioFlush 2024-09-22T04:00:18.475 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Entries.cc:263: Skipped 2024-09-22T04:00:18.475 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:18.475 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalEntries.AioFlush (35 ms) 2024-09-22T04:00:19.332 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from TestJournalEntries (2156 ms total) 2024-09-22T04:00:19.332 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T04:00:19.332 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T04:00:19.332 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 4 tests from 1 test suite ran. (4906 ms total) 2024-09-22T04:00:19.332 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 0 tests. 2024-09-22T04:00:19.332 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-22T04:00:19.332 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalEntries.AioWrite 2024-09-22T04:00:19.332 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard 2024-09-22T04:00:19.332 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune 2024-09-22T04:00:19.332 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalEntries.AioFlush 2024-09-22T04:00:19.436 INFO:tasks.workunit.client.0.smithi138.stdout:seed 33617 2024-09-22T04:00:19.438 INFO:tasks.workunit.client.0.smithi138.stdout:Note: Google Test filter = TestJournalReplay.* 2024-09-22T04:00:19.438 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 16 tests from 1 test suite. 2024-09-22T04:00:19.438 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-22T04:00:19.438 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 16 tests from TestJournalReplay 2024-09-22T04:00:21.346 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.AioDiscardEvent 2024-09-22T04:00:23.429 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:109: Skipped 2024-09-22T04:00:23.429 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.429 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent (2083 ms) 2024-09-22T04:00:23.429 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.AioWriteEvent 2024-09-22T04:00:23.464 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:200: Skipped 2024-09-22T04:00:23.465 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.465 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent (35 ms) 2024-09-22T04:00:23.465 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.AioFlushEvent 2024-09-22T04:00:23.500 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:261: Skipped 2024-09-22T04:00:23.501 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.501 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent (36 ms) 2024-09-22T04:00:23.501 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.SnapCreate 2024-09-22T04:00:23.539 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:307: Skipped 2024-09-22T04:00:23.539 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.539 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate (39 ms) 2024-09-22T04:00:23.539 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.SnapProtect 2024-09-22T04:00:23.574 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:348: Skipped 2024-09-22T04:00:23.574 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.574 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect (35 ms) 2024-09-22T04:00:23.574 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.SnapUnprotect 2024-09-22T04:00:23.609 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:394: Skipped 2024-09-22T04:00:23.610 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.610 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect (35 ms) 2024-09-22T04:00:23.610 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.SnapRename 2024-09-22T04:00:23.646 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:450: Skipped 2024-09-22T04:00:23.646 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.SnapRename (37 ms) 2024-09-22T04:00:23.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.SnapRollback 2024-09-22T04:00:23.682 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:500: Skipped 2024-09-22T04:00:23.682 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.682 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback (36 ms) 2024-09-22T04:00:23.682 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.SnapRemove 2024-09-22T04:00:23.717 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:541: Skipped 2024-09-22T04:00:23.717 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.717 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove (35 ms) 2024-09-22T04:00:23.717 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.Rename 2024-09-22T04:00:23.753 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:590: Skipped 2024-09-22T04:00:23.753 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.753 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.Rename (36 ms) 2024-09-22T04:00:23.753 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.Resize 2024-09-22T04:00:23.790 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:624: Skipped 2024-09-22T04:00:23.790 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.790 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.Resize (36 ms) 2024-09-22T04:00:23.790 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.Flatten 2024-09-22T04:00:23.826 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:657: Skipped 2024-09-22T04:00:23.826 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.826 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.Flatten (37 ms) 2024-09-22T04:00:23.827 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.UpdateFeatures 2024-09-22T04:00:23.862 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:704: Skipped 2024-09-22T04:00:23.862 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.862 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures (35 ms) 2024-09-22T04:00:23.862 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.MetadataSet 2024-09-22T04:00:23.898 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:741: Skipped 2024-09-22T04:00:23.898 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.899 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet (37 ms) 2024-09-22T04:00:23.899 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.MetadataRemove 2024-09-22T04:00:23.936 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:781: Skipped 2024-09-22T04:00:23.936 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.936 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove (38 ms) 2024-09-22T04:00:23.936 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestJournalReplay.ObjectPosition 2024-09-22T04:00:23.974 INFO:tasks.workunit.client.0.smithi138.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librbd/journal/test_Replay.cc:824: Skipped 2024-09-22T04:00:23.974 INFO:tasks.workunit.client.0.smithi138.stdout:Skipping due to unmet REQUIRE 2024-09-22T04:00:23.974 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition (37 ms) 2024-09-22T04:00:24.361 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 16 tests from TestJournalReplay (2627 ms total) 2024-09-22T04:00:24.361 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-22T04:00:24.361 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-22T04:00:24.361 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 16 tests from 1 test suite ran. (4923 ms total) 2024-09-22T04:00:24.361 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 0 tests. 2024-09-22T04:00:24.361 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-22T04:00:24.361 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent 2024-09-22T04:00:24.361 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent 2024-09-22T04:00:24.361 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent 2024-09-22T04:00:24.361 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate 2024-09-22T04:00:24.361 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect 2024-09-22T04:00:24.361 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect 2024-09-22T04:00:24.362 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.SnapRename 2024-09-22T04:00:24.362 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback 2024-09-22T04:00:24.362 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove 2024-09-22T04:00:24.362 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.Rename 2024-09-22T04:00:24.362 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.Resize 2024-09-22T04:00:24.362 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.Flatten 2024-09-22T04:00:24.362 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures 2024-09-22T04:00:24.362 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet 2024-09-22T04:00:24.362 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove 2024-09-22T04:00:24.362 INFO:tasks.workunit.client.0.smithi138.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition 2024-09-22T04:00:24.366 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T04:00:24.366 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T04:00:24.396 INFO:tasks.workunit:Stopping ['rbd/crimson/test_crimson_librbd.sh'] on client.0... 2024-09-22T04:00:24.397 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T04:00:24.829 DEBUG:teuthology.parallel:result is None 2024-09-22T04:00:24.830 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T04:00:24.858 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T04:00:24.858 DEBUG:teuthology.orchestra.run.smithi138:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T04:00:24.917 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T04:00:24.917 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-22T04:00:24.933 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T04:00:24.933 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:00:25.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:25.063+0000 7efd26591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:25.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:25.071+0000 7efd26591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:25.266 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T04:00:25.266 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-22T04:00:25.279 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":549,"stamp":"2024-09-22T04:00:24.354985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":101020,"kb_used_data":3884,"kb_used_omap":0,"kb_used_meta":97088,"kb_avail":283014500,"statfs":{"total":289910292480,"available":289806848000,"internally_reserved":0,"allocated":3977216,"data_stored":2787463,"data_compressed":60100,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":99418112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.018544"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":561,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.355089+0000","last_change":"2024-09-22T03:48:37.039738+0000","last_active":"2024-09-22T04:00:21.355089+0000","last_peered":"2024-09-22T04:00:21.355089+0000","last_clean":"2024-09-22T04:00:21.355089+0000","last_became_active":"2024-09-22T03:48:35.106569+0000","last_became_peered":"2024-09-22T03:48:35.106569+0000","last_unstale":"2024-09-22T04:00:21.355089+0000","last_undegraded":"2024-09-22T04:00:21.355089+0000","last_fullsized":"2024-09-22T04:00:21.355089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":561,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.360089+0000","last_change":"2024-09-22T03:48:37.043255+0000","last_active":"2024-09-22T04:00:21.360089+0000","last_peered":"2024-09-22T04:00:21.360089+0000","last_clean":"2024-09-22T04:00:21.360089+0000","last_became_active":"2024-09-22T03:48:35.118291+0000","last_became_peered":"2024-09-22T03:48:35.118291+0000","last_unstale":"2024-09-22T04:00:21.360089+0000","last_undegraded":"2024-09-22T04:00:21.360089+0000","last_fullsized":"2024-09-22T04:00:21.360089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":561,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.354363+0000","last_change":"2024-09-22T03:48:37.040780+0000","last_active":"2024-09-22T04:00:21.354363+0000","last_peered":"2024-09-22T04:00:21.354363+0000","last_clean":"2024-09-22T04:00:21.354363+0000","last_became_active":"2024-09-22T03:48:35.094134+0000","last_became_peered":"2024-09-22T03:48:35.094134+0000","last_unstale":"2024-09-22T04:00:21.354363+0000","last_undegraded":"2024-09-22T04:00:21.354363+0000","last_fullsized":"2024-09-22T04:00:21.354363+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":561,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.359336+0000","last_change":"2024-09-22T03:48:37.040927+0000","last_active":"2024-09-22T04:00:21.359336+0000","last_peered":"2024-09-22T04:00:21.359336+0000","last_clean":"2024-09-22T04:00:21.359336+0000","last_became_active":"2024-09-22T03:48:35.081605+0000","last_became_peered":"2024-09-22T03:48:35.081605+0000","last_unstale":"2024-09-22T04:00:21.359336+0000","last_undegraded":"2024-09-22T04:00:21.359336+0000","last_fullsized":"2024-09-22T04:00:21.359336+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":566,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-22T04:00:22.374249+0000","last_change":"2024-09-22T03:48:37.032028+0000","last_active":"2024-09-22T04:00:22.374249+0000","last_peered":"2024-09-22T04:00:22.374249+0000","last_clean":"2024-09-22T04:00:22.374249+0000","last_became_active":"2024-09-22T03:48:35.093109+0000","last_became_peered":"2024-09-22T03:48:35.093109+0000","last_unstale":"2024-09-22T04:00:22.374249+0000","last_undegraded":"2024-09-22T04:00:22.374249+0000","last_fullsized":"2024-09-22T04:00:22.374249+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":558,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-22T04:00:20.352910+0000","last_change":"2024-09-22T03:48:37.034489+0000","last_active":"2024-09-22T04:00:20.352910+0000","last_peered":"2024-09-22T04:00:20.352910+0000","last_clean":"2024-09-22T04:00:20.352910+0000","last_became_active":"2024-09-22T03:48:35.119446+0000","last_became_peered":"2024-09-22T03:48:35.119446+0000","last_unstale":"2024-09-22T04:00:20.352910+0000","last_undegraded":"2024-09-22T04:00:20.352910+0000","last_fullsized":"2024-09-22T04:00:20.352910+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":558,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-22T04:00:20.350739+0000","last_change":"2024-09-22T03:48:37.032421+0000","last_active":"2024-09-22T04:00:20.350739+0000","last_peered":"2024-09-22T04:00:20.350739+0000","last_clean":"2024-09-22T04:00:20.350739+0000","last_became_active":"2024-09-22T03:48:35.094076+0000","last_became_peered":"2024-09-22T03:48:35.094076+0000","last_unstale":"2024-09-22T04:00:20.350739+0000","last_undegraded":"2024-09-22T04:00:20.350739+0000","last_fullsized":"2024-09-22T04:00:20.350739+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":562,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.374496+0000","last_change":"2024-09-22T03:48:37.043010+0000","last_active":"2024-09-22T04:00:21.374496+0000","last_peered":"2024-09-22T04:00:21.374496+0000","last_clean":"2024-09-22T04:00:21.374496+0000","last_became_active":"2024-09-22T03:48:35.080621+0000","last_became_peered":"2024-09-22T03:48:35.080621+0000","last_unstale":"2024-09-22T04:00:21.374496+0000","last_undegraded":"2024-09-22T04:00:21.374496+0000","last_fullsized":"2024-09-22T04:00:21.374496+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":630,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.353348+0000","last_change":"2024-09-22T03:48:34.060794+0000","last_active":"2024-09-22T04:00:21.353348+0000","last_peered":"2024-09-22T04:00:21.353348+0000","last_clean":"2024-09-22T04:00:21.353348+0000","last_became_active":"2024-09-22T03:48:34.046386+0000","last_became_peered":"2024-09-22T03:48:34.046386+0000","last_unstale":"2024-09-22T04:00:21.353348+0000","last_undegraded":"2024-09-22T04:00:21.353348+0000","last_fullsized":"2024-09-22T04:00:21.353348+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:32.982948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:32.982948+0000","last_clean_scrub_stamp":"2024-09-22T03:48:32.982948+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739077,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32236,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1273856,"data_stored":531731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28148,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1347584,"data_stored":1125958,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739077,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40636,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94331204,"statfs":{"total":96636764160,"available":96595152896,"internally_reserved":0,"allocated":1355776,"data_stored":1129774,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:00:25.280 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:00:25.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:25.385+0000 7f706244f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:25.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:25.393+0000 7f706244f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:25.587 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T04:00:25.587 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-22T04:00:25.600 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":549,"stamp":"2024-09-22T04:00:24.354985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":101020,"kb_used_data":3884,"kb_used_omap":0,"kb_used_meta":97088,"kb_avail":283014500,"statfs":{"total":289910292480,"available":289806848000,"internally_reserved":0,"allocated":3977216,"data_stored":2787463,"data_compressed":60100,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":99418112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.018544"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":561,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.355089+0000","last_change":"2024-09-22T03:48:37.039738+0000","last_active":"2024-09-22T04:00:21.355089+0000","last_peered":"2024-09-22T04:00:21.355089+0000","last_clean":"2024-09-22T04:00:21.355089+0000","last_became_active":"2024-09-22T03:48:35.106569+0000","last_became_peered":"2024-09-22T03:48:35.106569+0000","last_unstale":"2024-09-22T04:00:21.355089+0000","last_undegraded":"2024-09-22T04:00:21.355089+0000","last_fullsized":"2024-09-22T04:00:21.355089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":561,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.360089+0000","last_change":"2024-09-22T03:48:37.043255+0000","last_active":"2024-09-22T04:00:21.360089+0000","last_peered":"2024-09-22T04:00:21.360089+0000","last_clean":"2024-09-22T04:00:21.360089+0000","last_became_active":"2024-09-22T03:48:35.118291+0000","last_became_peered":"2024-09-22T03:48:35.118291+0000","last_unstale":"2024-09-22T04:00:21.360089+0000","last_undegraded":"2024-09-22T04:00:21.360089+0000","last_fullsized":"2024-09-22T04:00:21.360089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":561,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.354363+0000","last_change":"2024-09-22T03:48:37.040780+0000","last_active":"2024-09-22T04:00:21.354363+0000","last_peered":"2024-09-22T04:00:21.354363+0000","last_clean":"2024-09-22T04:00:21.354363+0000","last_became_active":"2024-09-22T03:48:35.094134+0000","last_became_peered":"2024-09-22T03:48:35.094134+0000","last_unstale":"2024-09-22T04:00:21.354363+0000","last_undegraded":"2024-09-22T04:00:21.354363+0000","last_fullsized":"2024-09-22T04:00:21.354363+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":561,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.359336+0000","last_change":"2024-09-22T03:48:37.040927+0000","last_active":"2024-09-22T04:00:21.359336+0000","last_peered":"2024-09-22T04:00:21.359336+0000","last_clean":"2024-09-22T04:00:21.359336+0000","last_became_active":"2024-09-22T03:48:35.081605+0000","last_became_peered":"2024-09-22T03:48:35.081605+0000","last_unstale":"2024-09-22T04:00:21.359336+0000","last_undegraded":"2024-09-22T04:00:21.359336+0000","last_fullsized":"2024-09-22T04:00:21.359336+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":566,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-22T04:00:22.374249+0000","last_change":"2024-09-22T03:48:37.032028+0000","last_active":"2024-09-22T04:00:22.374249+0000","last_peered":"2024-09-22T04:00:22.374249+0000","last_clean":"2024-09-22T04:00:22.374249+0000","last_became_active":"2024-09-22T03:48:35.093109+0000","last_became_peered":"2024-09-22T03:48:35.093109+0000","last_unstale":"2024-09-22T04:00:22.374249+0000","last_undegraded":"2024-09-22T04:00:22.374249+0000","last_fullsized":"2024-09-22T04:00:22.374249+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":558,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-22T04:00:20.352910+0000","last_change":"2024-09-22T03:48:37.034489+0000","last_active":"2024-09-22T04:00:20.352910+0000","last_peered":"2024-09-22T04:00:20.352910+0000","last_clean":"2024-09-22T04:00:20.352910+0000","last_became_active":"2024-09-22T03:48:35.119446+0000","last_became_peered":"2024-09-22T03:48:35.119446+0000","last_unstale":"2024-09-22T04:00:20.352910+0000","last_undegraded":"2024-09-22T04:00:20.352910+0000","last_fullsized":"2024-09-22T04:00:20.352910+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":558,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-22T04:00:20.350739+0000","last_change":"2024-09-22T03:48:37.032421+0000","last_active":"2024-09-22T04:00:20.350739+0000","last_peered":"2024-09-22T04:00:20.350739+0000","last_clean":"2024-09-22T04:00:20.350739+0000","last_became_active":"2024-09-22T03:48:35.094076+0000","last_became_peered":"2024-09-22T03:48:35.094076+0000","last_unstale":"2024-09-22T04:00:20.350739+0000","last_undegraded":"2024-09-22T04:00:20.350739+0000","last_fullsized":"2024-09-22T04:00:20.350739+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":562,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.374496+0000","last_change":"2024-09-22T03:48:37.043010+0000","last_active":"2024-09-22T04:00:21.374496+0000","last_peered":"2024-09-22T04:00:21.374496+0000","last_clean":"2024-09-22T04:00:21.374496+0000","last_became_active":"2024-09-22T03:48:35.080621+0000","last_became_peered":"2024-09-22T03:48:35.080621+0000","last_unstale":"2024-09-22T04:00:21.374496+0000","last_undegraded":"2024-09-22T04:00:21.374496+0000","last_fullsized":"2024-09-22T04:00:21.374496+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":630,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.353348+0000","last_change":"2024-09-22T03:48:34.060794+0000","last_active":"2024-09-22T04:00:21.353348+0000","last_peered":"2024-09-22T04:00:21.353348+0000","last_clean":"2024-09-22T04:00:21.353348+0000","last_became_active":"2024-09-22T03:48:34.046386+0000","last_became_peered":"2024-09-22T03:48:34.046386+0000","last_unstale":"2024-09-22T04:00:21.353348+0000","last_undegraded":"2024-09-22T04:00:21.353348+0000","last_fullsized":"2024-09-22T04:00:21.353348+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:32.982948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:32.982948+0000","last_clean_scrub_stamp":"2024-09-22T03:48:32.982948+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739077,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32236,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1273856,"data_stored":531731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28148,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1347584,"data_stored":1125958,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739077,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40636,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94331204,"statfs":{"total":96636764160,"available":96595152896,"internally_reserved":0,"allocated":1355776,"data_stored":1129774,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:00:25.601 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T04:00:25.601 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:00:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:25.705+0000 7fcf43c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:25.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:25.713+0000 7fcf43c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:25.907 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T04:00:25.908 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-22T04:00:25.920 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":549,"stamp":"2024-09-22T04:00:24.354985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":101020,"kb_used_data":3884,"kb_used_omap":0,"kb_used_meta":97088,"kb_avail":283014500,"statfs":{"total":289910292480,"available":289806848000,"internally_reserved":0,"allocated":3977216,"data_stored":2787463,"data_compressed":60100,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":99418112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.018544"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":561,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.355089+0000","last_change":"2024-09-22T03:48:37.039738+0000","last_active":"2024-09-22T04:00:21.355089+0000","last_peered":"2024-09-22T04:00:21.355089+0000","last_clean":"2024-09-22T04:00:21.355089+0000","last_became_active":"2024-09-22T03:48:35.106569+0000","last_became_peered":"2024-09-22T03:48:35.106569+0000","last_unstale":"2024-09-22T04:00:21.355089+0000","last_undegraded":"2024-09-22T04:00:21.355089+0000","last_fullsized":"2024-09-22T04:00:21.355089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":561,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.360089+0000","last_change":"2024-09-22T03:48:37.043255+0000","last_active":"2024-09-22T04:00:21.360089+0000","last_peered":"2024-09-22T04:00:21.360089+0000","last_clean":"2024-09-22T04:00:21.360089+0000","last_became_active":"2024-09-22T03:48:35.118291+0000","last_became_peered":"2024-09-22T03:48:35.118291+0000","last_unstale":"2024-09-22T04:00:21.360089+0000","last_undegraded":"2024-09-22T04:00:21.360089+0000","last_fullsized":"2024-09-22T04:00:21.360089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":561,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.354363+0000","last_change":"2024-09-22T03:48:37.040780+0000","last_active":"2024-09-22T04:00:21.354363+0000","last_peered":"2024-09-22T04:00:21.354363+0000","last_clean":"2024-09-22T04:00:21.354363+0000","last_became_active":"2024-09-22T03:48:35.094134+0000","last_became_peered":"2024-09-22T03:48:35.094134+0000","last_unstale":"2024-09-22T04:00:21.354363+0000","last_undegraded":"2024-09-22T04:00:21.354363+0000","last_fullsized":"2024-09-22T04:00:21.354363+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":561,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.359336+0000","last_change":"2024-09-22T03:48:37.040927+0000","last_active":"2024-09-22T04:00:21.359336+0000","last_peered":"2024-09-22T04:00:21.359336+0000","last_clean":"2024-09-22T04:00:21.359336+0000","last_became_active":"2024-09-22T03:48:35.081605+0000","last_became_peered":"2024-09-22T03:48:35.081605+0000","last_unstale":"2024-09-22T04:00:21.359336+0000","last_undegraded":"2024-09-22T04:00:21.359336+0000","last_fullsized":"2024-09-22T04:00:21.359336+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":566,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-22T04:00:22.374249+0000","last_change":"2024-09-22T03:48:37.032028+0000","last_active":"2024-09-22T04:00:22.374249+0000","last_peered":"2024-09-22T04:00:22.374249+0000","last_clean":"2024-09-22T04:00:22.374249+0000","last_became_active":"2024-09-22T03:48:35.093109+0000","last_became_peered":"2024-09-22T03:48:35.093109+0000","last_unstale":"2024-09-22T04:00:22.374249+0000","last_undegraded":"2024-09-22T04:00:22.374249+0000","last_fullsized":"2024-09-22T04:00:22.374249+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":558,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-22T04:00:20.352910+0000","last_change":"2024-09-22T03:48:37.034489+0000","last_active":"2024-09-22T04:00:20.352910+0000","last_peered":"2024-09-22T04:00:20.352910+0000","last_clean":"2024-09-22T04:00:20.352910+0000","last_became_active":"2024-09-22T03:48:35.119446+0000","last_became_peered":"2024-09-22T03:48:35.119446+0000","last_unstale":"2024-09-22T04:00:20.352910+0000","last_undegraded":"2024-09-22T04:00:20.352910+0000","last_fullsized":"2024-09-22T04:00:20.352910+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":558,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-22T04:00:20.350739+0000","last_change":"2024-09-22T03:48:37.032421+0000","last_active":"2024-09-22T04:00:20.350739+0000","last_peered":"2024-09-22T04:00:20.350739+0000","last_clean":"2024-09-22T04:00:20.350739+0000","last_became_active":"2024-09-22T03:48:35.094076+0000","last_became_peered":"2024-09-22T03:48:35.094076+0000","last_unstale":"2024-09-22T04:00:20.350739+0000","last_undegraded":"2024-09-22T04:00:20.350739+0000","last_fullsized":"2024-09-22T04:00:20.350739+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":562,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.374496+0000","last_change":"2024-09-22T03:48:37.043010+0000","last_active":"2024-09-22T04:00:21.374496+0000","last_peered":"2024-09-22T04:00:21.374496+0000","last_clean":"2024-09-22T04:00:21.374496+0000","last_became_active":"2024-09-22T03:48:35.080621+0000","last_became_peered":"2024-09-22T03:48:35.080621+0000","last_unstale":"2024-09-22T04:00:21.374496+0000","last_undegraded":"2024-09-22T04:00:21.374496+0000","last_fullsized":"2024-09-22T04:00:21.374496+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":630,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-22T04:00:21.353348+0000","last_change":"2024-09-22T03:48:34.060794+0000","last_active":"2024-09-22T04:00:21.353348+0000","last_peered":"2024-09-22T04:00:21.353348+0000","last_clean":"2024-09-22T04:00:21.353348+0000","last_became_active":"2024-09-22T03:48:34.046386+0000","last_became_peered":"2024-09-22T03:48:34.046386+0000","last_unstale":"2024-09-22T04:00:21.353348+0000","last_undegraded":"2024-09-22T04:00:21.353348+0000","last_fullsized":"2024-09-22T04:00:21.353348+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:32.982948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:32.982948+0000","last_clean_scrub_stamp":"2024-09-22T03:48:32.982948+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739077,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32236,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1273856,"data_stored":531731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28148,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1347584,"data_stored":1125958,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739077,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40636,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94331204,"statfs":{"total":96636764160,"available":96595152896,"internally_reserved":0,"allocated":1355776,"data_stored":1129774,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:00:25.921 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T04:00:26.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:26.028+0000 7f376cd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:26.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:26.036+0000 7f376cd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:26.228 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T04:00:26.228 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":199,"fsid":"95b2c314-8275-411e-9a40-1e523f23b47f","created":"2024-09-22T03:48:23.191089+0000","modified":"2024-09-22T04:00:24.351339+0000","last_up_change":"2024-09-22T03:48:31.982044+0000","last_in_change":"2024-09-22T03:48:25.069001+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T03:48:31.993619+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T03:48:33.038521+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d1f7f779-0110-429e-b7ad-406a272d9840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1295064930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6805","nonce":1295064930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1295064930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1295064930}]},"public_addr":"172.21.15.138:6804/1295064930","cluster_addr":"172.21.15.138:6805/1295064930","heartbeat_back_addr":"172.21.15.138:6802/1295064930","heartbeat_front_addr":"172.21.15.138:6803/1295064930","state":["exists","up"]},{"osd":1,"uuid":"67a2ffcb-0897-47cd-b778-8ad762ae2ccb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1163497318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1163497318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1163497318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1163497318}]},"public_addr":"172.21.15.138:6811/1163497318","cluster_addr":"172.21.15.138:6810/1163497318","heartbeat_back_addr":"172.21.15.138:6813/1163497318","heartbeat_front_addr":"172.21.15.138:6812/1163497318","state":["exists","up"]},{"osd":2,"uuid":"003042e9-a66c-450a-972d-fb6ab50eeaee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1968358473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1968358473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6809","nonce":1968358473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1968358473}]},"public_addr":"172.21.15.138:6806/1968358473","cluster_addr":"172.21.15.138:6807/1968358473","heartbeat_back_addr":"172.21.15.138:6809/1968358473","heartbeat_front_addr":"172.21.15.138:6808/1968358473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":3,"snaps":[{"begin":2,"length":13},{"begin":17,"length":1},{"begin":21,"length":1},{"begin":24,"length":1},{"begin":28,"length":8}]},{"pool":4,"snaps":[{"begin":2,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1}]},{"pool":6,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":2,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":1}]},{"pool":20,"snaps":[{"begin":2,"length":4}]},{"pool":21,"snaps":[{"begin":2,"length":1}]},{"pool":22,"snaps":[{"begin":2,"length":1}]},{"pool":23,"snaps":[{"begin":2,"length":1}]},{"pool":24,"snaps":[{"begin":2,"length":1}]},{"pool":25,"snaps":[{"begin":2,"length":1}]},{"pool":26,"snaps":[{"begin":2,"length":1}]},{"pool":27,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T04:00:27.242 INFO:tasks.ceph:Scrubbing osd.0 2024-09-22T04:00:27.243 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-22T04:00:27.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:27.351+0000 7fe40f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:27.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:27.363+0000 7fe40f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:27.378 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-22T04:00:27.378 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "" 2024-09-22T04:00:27.378 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-22T04:00:27.390 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-22T04:00:27.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:27.494+0000 7f29e1cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:27.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:27.504+0000 7f29e1cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:27.693 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 0 to deep-scrub 2024-09-22T04:00:27.711 INFO:tasks.ceph:Scrubbing osd.1 2024-09-22T04:00:27.711 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-22T04:00:27.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:27.816+0000 7f3a82f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:27.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:27.828+0000 7f3a82f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:27.842 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-22T04:00:27.842 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "" 2024-09-22T04:00:27.842 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-22T04:00:27.853 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-22T04:00:27.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:27.957+0000 7f0b93391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:27.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:27.965+0000 7f0b93391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:28.156 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 1 to deep-scrub 2024-09-22T04:00:28.177 INFO:tasks.ceph:Scrubbing osd.2 2024-09-22T04:00:28.177 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-22T04:00:28.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:28.283+0000 7f7b62c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:28.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:28.295+0000 7f7b62c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-22T04:00:28.310 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "" 2024-09-22T04:00:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-22T04:00:28.322 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-22T04:00:28.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:28.425+0000 7f0472711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:28.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:28.434+0000 7f0472711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:28.627 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 2 to deep-scrub 2024-09-22T04:00:28.646 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:00:28.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:28.750+0000 7faf51191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:28.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:28.757+0000 7faf51191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:28.947 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T04:00:28.947 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-22T04:00:28.960 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":551,"stamp":"2024-09-22T04:00:28.174558+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":105272,"kb_used_data":3968,"kb_used_omap":0,"kb_used_meta":101248,"kb_avail":283010248,"statfs":{"total":289910292480,"available":289802493952,"internally_reserved":0,"allocated":4063232,"data_stored":2821135,"data_compressed":60100,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":103677952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001229"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":570,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.400209+0000","last_change":"2024-09-22T03:48:37.039738+0000","last_active":"2024-09-22T04:00:24.400209+0000","last_peered":"2024-09-22T04:00:24.400209+0000","last_clean":"2024-09-22T04:00:24.400209+0000","last_became_active":"2024-09-22T03:48:35.106569+0000","last_became_peered":"2024-09-22T03:48:35.106569+0000","last_unstale":"2024-09-22T04:00:24.400209+0000","last_undegraded":"2024-09-22T04:00:24.400209+0000","last_fullsized":"2024-09-22T04:00:24.400209+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":570,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.386714+0000","last_change":"2024-09-22T03:48:37.043255+0000","last_active":"2024-09-22T04:00:24.386714+0000","last_peered":"2024-09-22T04:00:24.386714+0000","last_clean":"2024-09-22T04:00:24.386714+0000","last_became_active":"2024-09-22T03:48:35.118291+0000","last_became_peered":"2024-09-22T03:48:35.118291+0000","last_unstale":"2024-09-22T04:00:24.386714+0000","last_undegraded":"2024-09-22T04:00:24.386714+0000","last_fullsized":"2024-09-22T04:00:24.386714+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":570,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.393280+0000","last_change":"2024-09-22T03:48:37.040780+0000","last_active":"2024-09-22T04:00:24.393280+0000","last_peered":"2024-09-22T04:00:24.393280+0000","last_clean":"2024-09-22T04:00:24.393280+0000","last_became_active":"2024-09-22T03:48:35.094134+0000","last_became_peered":"2024-09-22T03:48:35.094134+0000","last_unstale":"2024-09-22T04:00:24.393280+0000","last_undegraded":"2024-09-22T04:00:24.393280+0000","last_fullsized":"2024-09-22T04:00:24.393280+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":570,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.416401+0000","last_change":"2024-09-22T03:48:37.040927+0000","last_active":"2024-09-22T04:00:24.416401+0000","last_peered":"2024-09-22T04:00:24.416401+0000","last_clean":"2024-09-22T04:00:24.416401+0000","last_became_active":"2024-09-22T03:48:35.081605+0000","last_became_peered":"2024-09-22T03:48:35.081605+0000","last_unstale":"2024-09-22T04:00:24.416401+0000","last_undegraded":"2024-09-22T04:00:24.416401+0000","last_fullsized":"2024-09-22T04:00:24.416401+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":574,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:27.695041+0000","last_change":"2024-09-22T04:00:27.706287+0000","last_active":"2024-09-22T04:00:27.695041+0000","last_peered":"2024-09-22T04:00:27.695041+0000","last_clean":"2024-09-22T04:00:27.695041+0000","last_became_active":"2024-09-22T03:48:35.093109+0000","last_became_peered":"2024-09-22T03:48:35.093109+0000","last_unstale":"2024-09-22T04:00:27.695041+0000","last_undegraded":"2024-09-22T04:00:27.695041+0000","last_fullsized":"2024-09-22T04:00:27.695041+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2024-09-22T04:00:27.706016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:00:27.706016+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":570,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.469548+0000","last_change":"2024-09-22T03:48:37.034489+0000","last_active":"2024-09-22T04:00:24.469548+0000","last_peered":"2024-09-22T04:00:24.469548+0000","last_clean":"2024-09-22T04:00:24.469548+0000","last_became_active":"2024-09-22T03:48:35.119446+0000","last_became_peered":"2024-09-22T03:48:35.119446+0000","last_unstale":"2024-09-22T04:00:24.469548+0000","last_undegraded":"2024-09-22T04:00:24.469548+0000","last_fullsized":"2024-09-22T04:00:24.469548+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":570,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.428966+0000","last_change":"2024-09-22T03:48:37.032421+0000","last_active":"2024-09-22T04:00:24.428966+0000","last_peered":"2024-09-22T04:00:24.428966+0000","last_clean":"2024-09-22T04:00:24.428966+0000","last_became_active":"2024-09-22T03:48:35.094076+0000","last_became_peered":"2024-09-22T03:48:35.094076+0000","last_unstale":"2024-09-22T04:00:24.428966+0000","last_undegraded":"2024-09-22T04:00:24.428966+0000","last_fullsized":"2024-09-22T04:00:24.428966+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":571,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.391285+0000","last_change":"2024-09-22T03:48:37.043010+0000","last_active":"2024-09-22T04:00:24.391285+0000","last_peered":"2024-09-22T04:00:24.391285+0000","last_clean":"2024-09-22T04:00:24.391285+0000","last_became_active":"2024-09-22T03:48:35.080621+0000","last_became_peered":"2024-09-22T03:48:35.080621+0000","last_unstale":"2024-09-22T04:00:24.391285+0000","last_undegraded":"2024-09-22T04:00:24.391285+0000","last_fullsized":"2024-09-22T04:00:24.391285+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:33.983852+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":639,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.408886+0000","last_change":"2024-09-22T03:48:34.060794+0000","last_active":"2024-09-22T04:00:24.408886+0000","last_peered":"2024-09-22T04:00:24.408886+0000","last_clean":"2024-09-22T04:00:24.408886+0000","last_became_active":"2024-09-22T03:48:34.046386+0000","last_became_peered":"2024-09-22T03:48:34.046386+0000","last_unstale":"2024-09-22T04:00:24.408886+0000","last_undegraded":"2024-09-22T04:00:24.408886+0000","last_fullsized":"2024-09-22T04:00:24.408886+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:48:32.982948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:48:32.982948+0000","last_clean_scrub_stamp":"2024-09-22T03:48:32.982948+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32272,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1310720,"data_stored":546787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706377,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32336,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1376256,"data_stored":1137174,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40664,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94331176,"statfs":{"total":96636764160,"available":96595124224,"internally_reserved":0,"allocated":1376256,"data_stored":1137174,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:00:28.963 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-22T03:48:33.983852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=48, tm_sec=33, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=0, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:00:28.963 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-22T03:48:33.983852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=48, tm_sec=33, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=0, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:00:28.963 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-22T03:48:33.983852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=48, tm_sec=33, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=0, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:00:28.963 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-22T03:48:33.983852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=48, tm_sec=33, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=0, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:00:28.963 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-22T03:48:33.983852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=48, tm_sec=33, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=0, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:00:28.963 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-22T03:48:33.983852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=48, tm_sec=33, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=0, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:00:28.964 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-22T03:48:33.983852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=48, tm_sec=33, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=0, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:00:28.964 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-22T03:48:32.982948+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=48, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=0, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:00:28.964 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T04:00:48.965 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:00:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:49.083+0000 7f7d9ee57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:49.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:49.091+0000 7f7d9ee57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:49.280 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-22T04:00:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-22T04:00:49.293 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":561,"stamp":"2024-09-22T04:00:48.179469+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":105272,"kb_used_data":3968,"kb_used_omap":0,"kb_used_meta":101248,"kb_avail":283010248,"statfs":{"total":289910292480,"available":289802493952,"internally_reserved":0,"allocated":4063232,"data_stored":2821135,"data_compressed":60100,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":103677952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003066"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":572,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.164666+0000","last_change":"2024-09-22T04:00:28.190213+0000","last_active":"2024-09-22T04:00:28.164666+0000","last_peered":"2024-09-22T04:00:28.164666+0000","last_clean":"2024-09-22T04:00:28.164666+0000","last_became_active":"2024-09-22T03:48:35.106569+0000","last_became_peered":"2024-09-22T03:48:35.106569+0000","last_unstale":"2024-09-22T04:00:28.164666+0000","last_undegraded":"2024-09-22T04:00:28.164666+0000","last_fullsized":"2024-09-22T04:00:28.164666+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:00:28.190045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:00:28.190045+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":572,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.162592+0000","last_change":"2024-09-22T04:00:28.180107+0000","last_active":"2024-09-22T04:00:28.162592+0000","last_peered":"2024-09-22T04:00:28.162592+0000","last_clean":"2024-09-22T04:00:28.162592+0000","last_became_active":"2024-09-22T03:48:35.118291+0000","last_became_peered":"2024-09-22T03:48:35.118291+0000","last_unstale":"2024-09-22T04:00:28.162592+0000","last_undegraded":"2024-09-22T04:00:28.162592+0000","last_fullsized":"2024-09-22T04:00:28.162592+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:00:28.179835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:00:28.179835+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":572,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.161430+0000","last_change":"2024-09-22T04:00:28.187461+0000","last_active":"2024-09-22T04:00:28.161430+0000","last_peered":"2024-09-22T04:00:28.161430+0000","last_clean":"2024-09-22T04:00:28.161430+0000","last_became_active":"2024-09-22T03:48:35.094134+0000","last_became_peered":"2024-09-22T03:48:35.094134+0000","last_unstale":"2024-09-22T04:00:28.161430+0000","last_undegraded":"2024-09-22T04:00:28.161430+0000","last_fullsized":"2024-09-22T04:00:28.161430+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:00:28.187272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:00:28.187272+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":572,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.160121+0000","last_change":"2024-09-22T04:00:28.184408+0000","last_active":"2024-09-22T04:00:28.160121+0000","last_peered":"2024-09-22T04:00:28.160121+0000","last_clean":"2024-09-22T04:00:28.160121+0000","last_became_active":"2024-09-22T03:48:35.081605+0000","last_became_peered":"2024-09-22T03:48:35.081605+0000","last_unstale":"2024-09-22T04:00:28.160121+0000","last_undegraded":"2024-09-22T04:00:28.160121+0000","last_fullsized":"2024-09-22T04:00:28.160121+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:00:28.184125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:00:28.184125+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":574,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:27.695041+0000","last_change":"2024-09-22T04:00:27.706287+0000","last_active":"2024-09-22T04:00:27.695041+0000","last_peered":"2024-09-22T04:00:27.695041+0000","last_clean":"2024-09-22T04:00:27.695041+0000","last_became_active":"2024-09-22T03:48:35.093109+0000","last_became_peered":"2024-09-22T03:48:35.093109+0000","last_unstale":"2024-09-22T04:00:27.695041+0000","last_undegraded":"2024-09-22T04:00:27.695041+0000","last_fullsized":"2024-09-22T04:00:27.695041+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2024-09-22T04:00:27.706016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:00:27.706016+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":572,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.630695+0000","last_change":"2024-09-22T04:00:28.640180+0000","last_active":"2024-09-22T04:00:28.630695+0000","last_peered":"2024-09-22T04:00:28.630695+0000","last_clean":"2024-09-22T04:00:28.630695+0000","last_became_active":"2024-09-22T03:48:35.119446+0000","last_became_peered":"2024-09-22T03:48:35.119446+0000","last_unstale":"2024-09-22T04:00:28.630695+0000","last_undegraded":"2024-09-22T04:00:28.630695+0000","last_fullsized":"2024-09-22T04:00:28.630695+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:00:28.640016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:00:28.640016+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":572,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.629026+0000","last_change":"2024-09-22T04:00:28.637664+0000","last_active":"2024-09-22T04:00:28.629026+0000","last_peered":"2024-09-22T04:00:28.629026+0000","last_clean":"2024-09-22T04:00:28.629026+0000","last_became_active":"2024-09-22T03:48:35.094076+0000","last_became_peered":"2024-09-22T03:48:35.094076+0000","last_unstale":"2024-09-22T04:00:28.629026+0000","last_undegraded":"2024-09-22T04:00:28.629026+0000","last_fullsized":"2024-09-22T04:00:28.629026+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:00:28.637388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:00:28.637388+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":573,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.160187+0000","last_change":"2024-09-22T04:00:28.189115+0000","last_active":"2024-09-22T04:00:28.160187+0000","last_peered":"2024-09-22T04:00:28.160187+0000","last_clean":"2024-09-22T04:00:28.160187+0000","last_became_active":"2024-09-22T03:48:35.080621+0000","last_became_peered":"2024-09-22T03:48:35.080621+0000","last_unstale":"2024-09-22T04:00:28.160187+0000","last_undegraded":"2024-09-22T04:00:28.160187+0000","last_fullsized":"2024-09-22T04:00:28.160187+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'1","last_scrub_stamp":"2024-09-22T04:00:28.188941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:00:28.188941+0000","last_clean_scrub_stamp":"2024-09-22T03:48:33.983852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":641,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.158297+0000","last_change":"2024-09-22T04:00:28.192615+0000","last_active":"2024-09-22T04:00:28.158297+0000","last_peered":"2024-09-22T04:00:28.158297+0000","last_clean":"2024-09-22T04:00:28.158297+0000","last_became_active":"2024-09-22T03:48:34.046386+0000","last_became_peered":"2024-09-22T03:48:34.046386+0000","last_unstale":"2024-09-22T04:00:28.158297+0000","last_undegraded":"2024-09-22T04:00:28.158297+0000","last_fullsized":"2024-09-22T04:00:28.158297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"11'52","last_scrub_stamp":"2024-09-22T04:00:28.192419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:00:28.192419+0000","last_clean_scrub_stamp":"2024-09-22T03:48:32.982948+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739102,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32272,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1310720,"data_stored":546787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706397,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32336,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1376256,"data_stored":1137174,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739102,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40664,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94331176,"statfs":{"total":96636764160,"available":96595124224,"internally_reserved":0,"allocated":1376256,"data_stored":1137174,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:00:49.294 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-22T04:00:49.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:49.393+0000 7f71a1751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:49.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-22T04:00:49.404+0000 7f71a1751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:49.620 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-22T04:00:49.620 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-22T04:00:49.620 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-22T04:00:49.620 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T04:00:49.692 INFO:tasks.ceph.osd.0:Stopped 2024-09-22T04:00:49.692 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-22T04:00:49.692 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T04:00:49.777 INFO:tasks.ceph.osd.1:Stopped 2024-09-22T04:00:49.777 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-22T04:00:49.777 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T04:00:49.861 INFO:tasks.ceph.osd.2:Stopped 2024-09-22T04:00:49.861 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-22T04:00:49.861 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-22T04:00:49.861 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T04:00:49.890 INFO:tasks.ceph.mgr.x:Stopped 2024-09-22T04:00:49.890 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-22T04:00:49.890 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-22T04:00:49.891 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T04:00:49.943 INFO:tasks.ceph.mon.a:Stopped 2024-09-22T04:00:49.943 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-22T04:00:49.944 DEBUG:teuthology.orchestra.run.smithi138:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'is full \(reached quota' | egrep -v '\(POOL_FULL\)' | head -n 1 2024-09-22T04:00:50.076 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-22T04:00:50.076 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-22T04:00:50.227 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-22T04:00:50.227 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-22T04:00:50.316 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-22T04:00:50.316 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-22T04:00:50.390 INFO:tasks.ceph:Archiving mon data... 2024-09-22T04:00:50.391 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914377/data/mon.a.tgz 2024-09-22T04:00:50.392 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-09-22T04:00:50.410 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.dghuQRx9ex 2024-09-22T04:00:50.411 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.dghuQRx9ex 2024-09-22T04:00:50.554 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.dghuQRx9ex 2024-09-22T04:00:50.637 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.dghuQRx9ex is 257KB 2024-09-22T04:00:50.730 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.dghuQRx9ex 2024-09-22T04:00:50.745 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-22T04:00:50.745 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T04:00:50.865 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T04:00:50.865 INFO:tasks.ceph:Archiving crash dumps... 2024-09-22T04:00:50.866 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914377/remote/smithi138/crash 2024-09-22T04:00:50.867 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T04:00:50.929 INFO:tasks.ceph:Compressing logs... 2024-09-22T04:00:50.929 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T04:00:50.994 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-22T04:00:50.994 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33369.log 2024-09-22T04:00:51.007 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33807.log 2024-09-22T04:00:51.007 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.33369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34104.log 2024-09-22T04:00:51.007 INFO:teuthology.orchestra.run.smithi138.stderr: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.33369.log.gz 2024-09-22T04:00:51.007 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33807.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33807.log.gz 2024-09-22T04:00:51.008 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33320.log 2024-09-22T04:00:51.008 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30009.log 2024-09-22T04:00:51.008 INFO:teuthology.orchestra.run.smithi138.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34104.log.gz 2024-09-22T04:00:51.008 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33320.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-22T04:00:51.008 INFO:teuthology.orchestra.run.smithi138.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.33320.log.gz 2024-09-22T04:00:51.008 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.30009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28946.log 2024-09-22T04:00:51.008 INFO:teuthology.orchestra.run.smithi138.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30009.log.gz 2024-09-22T04:00:51.008 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33936.log 2024-09-22T04:00:51.008 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.28946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32651.log 2024-09-22T04:00:51.008 INFO:teuthology.orchestra.run.smithi138.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28946.log.gz 2024-09-22T04:00:51.008 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30215.log 2024-09-22T04:00:51.008 INFO:teuthology.orchestra.run.smithi138.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33936.log.gz 2024-09-22T04:00:51.008 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32523.log 2024-09-22T04:00:51.008 INFO:teuthology.orchestra.run.smithi138.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.32651.log.gz 2024-09-22T04:00:51.009 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.30215.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30215.log.gz 2024-09-22T04:00:51.009 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29145.log 2024-09-22T04:00:51.009 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32523.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.32523.log.gz 2024-09-22T04:00:51.009 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32267.log 2024-09-22T04:00:51.009 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.29145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32459.log 2024-09-22T04:00:51.009 INFO:teuthology.orchestra.run.smithi138.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29145.log.gz 2024-09-22T04:00:51.009 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28858.log 2024-09-22T04:00:51.009 INFO:teuthology.orchestra.run.smithi138.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.32267.log.gz 2024-09-22T04:00:51.009 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29056.log 2024-09-22T04:00:51.009 INFO:teuthology.orchestra.run.smithi138.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.32459.log.gz 2024-09-22T04:00:51.009 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.28858.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28858.log.gz 2024-09-22T04:00:51.009 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30216.log 2024-09-22T04:00:51.009 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.29056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34233.log 2024-09-22T04:00:51.009 INFO:teuthology.orchestra.run.smithi138.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29056.log.gz 2024-09-22T04:00:51.010 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.30216.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30216.log.gz 2024-09-22T04:00:51.010 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33470.log 2024-09-22T04:00:51.010 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29788.log 2024-09-22T04:00:51.010 INFO:teuthology.orchestra.run.smithi138.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34233.log.gz 2024-09-22T04:00:51.010 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29096.log 2024-09-22T04:00:51.010 INFO:teuthology.orchestra.run.smithi138.stderr: 75.9% -- replaced with /var/log/ceph/ceph-client.admin.33470.log.gz 2024-09-22T04:00:51.010 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.29788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34062.log 2024-09-22T04:00:51.010 INFO:teuthology.orchestra.run.smithi138.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29788.log.gz 2024-09-22T04:00:51.010 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.29096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32816.log 2024-09-22T04:00:51.010 INFO:teuthology.orchestra.run.smithi138.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29096.log.gz 2024-09-22T04:00:51.010 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34062.log: gzip 49.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.34062.log.gz --verbose 2024-09-22T04:00:51.010 INFO:teuthology.orchestra.run.smithi138.stderr: -- /var/log/ceph/ceph.audit.log 2024-09-22T04:00:51.010 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32331.log 2024-09-22T04:00:51.010 INFO:teuthology.orchestra.run.smithi138.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.32816.log.gz 2024-09-22T04:00:51.010 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29883.log 2024-09-22T04:00:51.011 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32331.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.32331.log.gz 2024-09-22T04:00:51.011 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32715.log 2024-09-22T04:00:51.011 INFO:teuthology.orchestra.run.smithi138.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-22T04:00:51.011 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30091.log 2024-09-22T04:00:51.011 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.29883.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29883.log.gz 2024-09-22T04:00:51.011 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30089.log 2024-09-22T04:00:51.011 INFO:teuthology.orchestra.run.smithi138.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.32715.log.gz 2024-09-22T04:00:51.011 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.30091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33568.log 2024-09-22T04:00:51.011 INFO:teuthology.orchestra.run.smithi138.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30091.log.gz 2024-09-22T04:00:51.011 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.30089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30217.log 2024-09-22T04:00:51.011 INFO:teuthology.orchestra.run.smithi138.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30089.log.gz 2024-09-22T04:00:51.011 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29813.log 2024-09-22T04:00:51.011 INFO:teuthology.orchestra.run.smithi138.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.33568.log.gz 2024-09-22T04:00:51.011 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.30217.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30217.log.gz -5 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33519.log 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.29813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34188.log 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.29813.log.gz 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29305.log 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr: 76.8% -- replaced with /var/log/ceph/ceph-client.admin.33519.log.gz 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32395.log 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34188.log.gz 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.29305.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29305.log.gz 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30606.log 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30387.log 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32395.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.32395.log.gz 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.30606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33421.log 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.30387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34020.log 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30387.log.gz 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.30606.log.gz 2024-09-22T04:00:51.012 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33421.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-22T04:00:51.013 INFO:teuthology.orchestra.run.smithi138.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.33421.log.gz 2024-09-22T04:00:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34273.log 2024-09-22T04:00:51.013 INFO:teuthology.orchestra.run.smithi138.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34020.log.gz 2024-09-22T04:00:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30345.log 2024-09-22T04:00:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34273.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 49.6% 2024-09-22T04:00:51.013 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34273.log.gz 2024-09-22T04:00:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33617.log 2024-09-22T04:00:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.30345.log: /var/log/ceph/ceph-osd.2.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30345.log.gz 2024-09-22T04:00:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33978.log 2024-09-22T04:00:51.021 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32203.log 2024-09-22T04:00:51.021 INFO:teuthology.orchestra.run.smithi138.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.33617.log.gz 2024-09-22T04:00:51.022 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33851.log 2024-09-22T04:00:51.022 INFO:teuthology.orchestra.run.smithi138.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33978.log.gz 2024-09-22T04:00:51.022 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32203.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-22T04:00:51.022 INFO:teuthology.orchestra.run.smithi138.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.32203.log.gz 2024-09-22T04:00:51.022 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33851.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33851.log.gz 2024-09-22T04:00:51.022 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29925.log 2024-09-22T04:00:51.022 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32764.log 2024-09-22T04:00:51.022 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.29925.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29925.log.gz 2024-09-22T04:00:51.022 INFO:teuthology.orchestra.run.smithi138.stderr: /var/log/ceph/ceph-mgr.x.log 2024-09-22T04:00:51.022 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32764.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29732.log 2024-09-22T04:00:51.022 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32764.log.gz 2024-09-22T04:00:51.022 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29335.log 2024-09-22T04:00:51.022 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33893.log 2024-09-22T04:00:51.022 INFO:teuthology.orchestra.run.smithi138.stderr: 86.7%/var/log/ceph/ceph-client.admin.29335.log: /var/log/ceph/ceph-client.admin.29732.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-22T04:00:51.023 INFO:teuthology.orchestra.run.smithi138.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29335.log.gz 2024-09-22T04:00:51.023 INFO:teuthology.orchestra.run.smithi138.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29732.log.gz 2024-09-22T04:00:51.023 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30090.log 2024-09-22T04:00:51.023 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33893.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33893.log.gz 2024-09-22T04:00:51.023 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27493.log 2024-09-22T04:00:51.023 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.30090.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30090.log.gz 2024-09-22T04:00:51.023 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30303.log 2024-09-22T04:00:51.023 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.tmp-client.admin.27493.log: 66.9% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27493.log.gz 2024-09-22T04:00:51.023 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33757.log 2024-09-22T04:00:51.023 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.30303.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30303.log.gz 2024-09-22T04:00:51.023 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29967.log 2024-09-22T04:00:51.024 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33757.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33757.log.gz 2024-09-22T04:00:51.024 INFO:teuthology.orchestra.run.smithi138.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32587.log 2024-09-22T04:00:51.024 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.29967.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29967.log.gz 2024-09-22T04:00:51.024 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34146.log 2024-09-22T04:00:51.024 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32587.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.32587.log.gz 2024-09-22T04:00:51.024 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34146.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34146.log.gz 2024-09-22T04:00:51.102 INFO:teuthology.orchestra.run.smithi138.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-22T04:00:51.328 INFO:teuthology.orchestra.run.smithi138.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-22T04:00:55.075 INFO:teuthology.orchestra.run.smithi138.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-22T04:00:56.176 INFO:teuthology.orchestra.run.smithi138.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-22T04:00:57.774 INFO:teuthology.orchestra.run.smithi138.stderr: 95.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-22T04:00:57.775 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-22T04:00:57.776 INFO:teuthology.orchestra.run.smithi138.stderr:real 0m6.791s 2024-09-22T04:00:57.776 INFO:teuthology.orchestra.run.smithi138.stderr:user 0m15.723s 2024-09-22T04:00:57.776 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m0.749s 2024-09-22T04:00:57.776 INFO:tasks.ceph:Archiving logs... 2024-09-22T04:00:57.776 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914377/remote/smithi138/log 2024-09-22T04:00:57.777 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T04:00:59.792 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-22T04:00:59.801 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-22T04:00:59.801 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T04:00:59.866 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-22T04:00:59.874 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-22T04:00:59.875 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T04:00:59.895 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-09-22T04:00:59.900 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T04:00:59.900 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-09-22T04:00:59.900 INFO:teuthology.orchestra.run.smithi138.stdout:^* hv01.front.sepia.ceph.com 3 6 377 25 -425us[ -357us] +/- 43ms 2024-09-22T04:00:59.900 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 25 +875us[ +875us] +/- 52ms 2024-09-22T04:00:59.900 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 -518us[ -449us] +/- 85ms 2024-09-22T04:00:59.900 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T04:00:59.900 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-22T04:00:59.908 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-22T04:00:59.908 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-22T04:00:59.916 DEBUG:teuthology.orchestra.run.smithi138:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T04:01:00.002 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T04:01:00.029 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T04:01:00.030 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-22T04:01:00.038 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-22T04:01:00.045 INFO:teuthology.task.internal:Duration was 1164.517917 seconds 2024-09-22T04:01:00.045 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-22T04:01:00.053 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-22T04:01:00.053 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T04:01:00.108 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T04:01:00.346 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-22T04:01:00.346 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-09-22T04:01:00.346 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T04:01:00.406 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-22T04:01:00.407 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T04:01:00.472 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-22T04:01:00.472 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T04:01:00.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-22T04:01:00.621 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-22T04:01:00.621 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T04:01:00.646 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-22T04:01:00.655 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T04:01:00.709 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-09-22T04:01:00.723 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T04:01:00.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T04:01:00.781 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-22T04:01:00.791 INFO:teuthology.task.internal:Transferring archived files... 2024-09-22T04:01:00.791 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914377/remote/smithi138 2024-09-22T04:01:00.791 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T04:01:00.853 INFO:teuthology.task.internal:Removing archive directory... 2024-09-22T04:01:00.853 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T04:01:00.903 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-22T04:01:00.913 INFO:teuthology.task.internal:Not uploading archives. 2024-09-22T04:01:00.913 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-22T04:01:00.922 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-22T04:01:00.922 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T04:01:00.958 INFO:teuthology.orchestra.run.smithi138.stdout: 265972 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 04:01 /home/ubuntu/cephtest 2024-09-22T04:01:00.959 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-22T04:01:00.968 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-22T04:01:00.986 INFO:teuthology.run:Summary data: description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests_old_format} duration: 1164.517917394638 flavor: crimson owner: scheduled_teuthology@teuthology success: true 2024-09-22T04:01:00.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T04:01:01.063 INFO:teuthology.run:pass