2024-09-16T07:28:39.473 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T07:28:39.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T07:28:39.569 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906865 branch: wip-matanb-crimson-testing-59543 description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rbd_api_tests_old_format} email: null first_in_suite: false job_id: '7906865' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-59543 ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug ms: 1 debug osd: 20 osd objectstore: seastore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-1 osd.1: crimson seastar cpu cores: 2-3 osd.2: crimson seastar cpu cores: 4-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_APP_NOT_ENABLED\) - is full \(reached quota - \(POOL_FULL\) sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: crimson sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 6651 sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAJ9vxCelvAMb8R+u1YFKYjTwOAKTtZteoOtJYRXaKAIMvEIN0M/egP4u/OvDq26oy/gDFoyUWTtPJtdU3Ye20o= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rbd/crimson/test_crimson_librbd.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_07:15:55 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T07:28:39.569 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-16T07:28:39.570 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-16T07:28:39.570 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T07:28:39.571 INFO:teuthology.task.internal:Checking packages... 2024-09-16T07:28:39.593 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '81fedcb3b484c843d22ffbc8d179cb567b7083b5' 2024-09-16T07:28:39.593 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T07:28:39.593 INFO:teuthology.packaging:ref: None 2024-09-16T07:28:39.593 INFO:teuthology.packaging:tag: None 2024-09-16T07:28:39.593 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-59543 2024-09-16T07:28:39.593 INFO:teuthology.packaging:sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:28:39.594 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-59543 2024-09-16T07:28:39.740 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4879.g81fedcb3 2024-09-16T07:28:39.741 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T07:28:39.748 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T07:28:39.748 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T07:28:39.756 INFO:teuthology.task.internal:Saving configuration 2024-09-16T07:28:39.767 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T07:28:39.779 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T07:28:39.803 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906865', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 07:23:31.141172', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAJ9vxCelvAMb8R+u1YFKYjTwOAKTtZteoOtJYRXaKAIMvEIN0M/egP4u/OvDq26oy/gDFoyUWTtPJtdU3Ye20o='} 2024-09-16T07:28:39.803 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T07:28:39.809 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-09-16T07:28:39.809 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T07:28:39.846 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe7f7903be0>, signals=[15]) 2024-09-16T07:28:39.846 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T07:28:39.852 INFO:teuthology.task.internal:Opening connections... 2024-09-16T07:28:39.852 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2024-09-16T07:28:39.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:28:39.934 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T07:28:39.941 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-09-16T07:28:40.015 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-09-16T07:28:40.015 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-09-16T07:28:40.073 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2024-09-16T07:28:40.073 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2024-09-16T07:28:40.073 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2024-09-16T07:28:40.073 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2024-09-16T07:28:40.073 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2024-09-16T07:28:40.073 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2024-09-16T07:28:40.073 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T07:28:40.073 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2024-09-16T07:28:40.073 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2024-09-16T07:28:40.074 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T07:28:40.074 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2024-09-16T07:28:40.074 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T07:28:40.074 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T07:28:40.074 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T07:28:40.074 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-09-16T07:28:40.123 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T07:28:40.131 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T07:28:40.197 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T07:28:40.197 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2024-09-16T07:28:40.215 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T07:28:40.221 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T07:28:40.222 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2024-09-16T07:28:40.355 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T07:28:40.386 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T07:28:40.402 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-16T07:28:40.402 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-16T07:28:40.402 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T07:28:40.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:28:40.420 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-09-16T07:28:40.479 INFO:teuthology.orchestra.run.smithi151.stdout:5.14.0-503.el9.x86_64 2024-09-16T07:28:40.479 INFO:teuthology.task.kernel:Running kernel on smithi151: 5.14.0-503.el9.x86_64 2024-09-16T07:28:40.479 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum install -y kernel 2024-09-16T07:28:42.922 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-16T07:28:48.330 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 20 MB 00:04 2024-09-16T07:28:53.898 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-16T07:28:55.514 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-16T07:28:56.544 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-16T07:29:01.949 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-16T07:29:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T07:29:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T07:29:04.066 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:29:04.071 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:29:04.071 INFO:teuthology.orchestra.run.smithi151.stdout: Package Architecture Version Repository Size 2024-09-16T07:29:04.071 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:29:04.072 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:29:04.072 INFO:teuthology.orchestra.run.smithi151.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T07:29:04.072 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-09-16T07:29:04.072 INFO:teuthology.orchestra.run.smithi151.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T07:29:04.072 INFO:teuthology.orchestra.run.smithi151.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T07:29:04.072 INFO:teuthology.orchestra.run.smithi151.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T07:29:04.072 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:29:04.072 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:29:04.072 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:29:04.072 INFO:teuthology.orchestra.run.smithi151.stdout:Install 4 Packages 2024-09-16T07:29:04.073 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:29:04.073 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 79 M 2024-09-16T07:29:04.073 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 126 M 2024-09-16T07:29:04.074 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:29:04.209 INFO:teuthology.orchestra.run.smithi151.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 266 kB/s | 23 kB 00:00 2024-09-16T07:29:04.743 INFO:teuthology.orchestra.run.smithi151.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-16T07:29:05.309 INFO:teuthology.orchestra.run.smithi151.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-16T07:29:05.968 INFO:teuthology.orchestra.run.smithi151.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 16 MB/s | 29 MB 00:01 2024-09-16T07:29:05.968 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:29:05.969 INFO:teuthology.orchestra.run.smithi151.stdout:Total 42 MB/s | 79 MB 00:01 2024-09-16T07:29:06.652 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:29:07.014 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:29:07.014 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:29:08.013 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:29:08.014 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:29:10.465 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:29:11.195 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:29:11.301 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:29:14.081 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:29:14.226 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:29:19.067 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:29:19.177 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:29:24.089 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:30:02.558 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:30:02.598 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:30:02.917 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:30:02.918 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:30:02.918 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:30:02.918 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:30:03.807 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:30:03.808 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:30:03.808 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:30:03.808 INFO:teuthology.orchestra.run.smithi151.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T07:30:03.808 INFO:teuthology.orchestra.run.smithi151.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T07:30:03.808 INFO:teuthology.orchestra.run.smithi151.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T07:30:03.808 INFO:teuthology.orchestra.run.smithi151.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T07:30:03.808 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:30:03.808 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:30:04.174 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:30:04.259 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:30:04.259 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:30:04.259 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T07:30:04.259 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T07:30:04.259 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T07:30:04.260 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T07:30:04.260 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T07:30:04.260 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:30:04.319 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:30:04.319 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:30:04.319 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -qi grub2-tools 2024-09-16T07:30:04.357 INFO:teuthology.orchestra.run.smithi151.stdout:Name : grub2-tools 2024-09-16T07:30:04.357 INFO:teuthology.orchestra.run.smithi151.stdout:Epoch : 1 2024-09-16T07:30:04.357 INFO:teuthology.orchestra.run.smithi151.stdout:Version : 2.06 2024-09-16T07:30:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:Release : 82.el9 2024-09-16T07:30:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: x86_64 2024-09-16T07:30:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T07:30:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:Group : Unspecified 2024-09-16T07:30:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:Size : 8274670 2024-09-16T07:30:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:License : GPLv3+ 2024-09-16T07:30:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T07:30:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T07:30:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T07:30:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T07:30:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:Packager : builder@centos.org 2024-09-16T07:30:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:Vendor : CentOS 2024-09-16T07:30:04.359 INFO:teuthology.orchestra.run.smithi151.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T07:30:04.359 INFO:teuthology.orchestra.run.smithi151.stdout:Summary : Support tools for GRUB. 2024-09-16T07:30:04.359 INFO:teuthology.orchestra.run.smithi151.stdout:Description : 2024-09-16T07:30:04.359 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:30:04.359 INFO:teuthology.orchestra.run.smithi151.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T07:30:04.359 INFO:teuthology.orchestra.run.smithi151.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T07:30:04.359 INFO:teuthology.orchestra.run.smithi151.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T07:30:04.359 INFO:teuthology.orchestra.run.smithi151.stdout:hardware devices. 2024-09-16T07:30:04.359 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:30:04.359 INFO:teuthology.orchestra.run.smithi151.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T07:30:04.360 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T07:30:04.360 INFO:teuthology.task.kernel:Updating grub on smithi151 to boot 5.14.0-505.el9.x86_64 2024-09-16T07:30:04.360 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T07:30:05.010 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2024-09-16T07:30:06.299 INFO:teuthology.orchestra.run.smithi151.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T07:30:06.333 INFO:teuthology.orchestra.run.smithi151.stderr:done 2024-09-16T07:30:06.336 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-09-16T07:30:06.351 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.lbLKsgWhL3 2024-09-16T07:30:06.352 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lbLKsgWhL3 2024-09-16T07:30:06.419 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.lbLKsgWhL3 2024-09-16T07:30:06.555 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.lbLKsgWhL3 is 6KB 2024-09-16T07:30:06.602 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.lbLKsgWhL3 2024-09-16T07:30:06.617 DEBUG:teuthology.orchestra.run.smithi151:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T07:30:06.680 INFO:teuthology.orchestra.run.smithi151.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T07:30:06.680 INFO:teuthology.orchestra.run.smithi151.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T07:30:06.680 INFO:teuthology.orchestra.run.smithi151.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T07:30:06.681 INFO:teuthology.orchestra.run.smithi151.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T07:30:06.684 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T07:30:06.825 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2024-09-16T07:30:36.857 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T07:30:36.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-16T07:30:36.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:30:55.421 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-16T07:31:04.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-16T07:31:04.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:31:07.489 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-16T07:31:19.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-16T07:31:19.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:31:37.921 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-16T07:31:52.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-16T07:31:52.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:31:53.625 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-09-16T07:31:54.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-16T07:31:54.085 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T07:31:54.085 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-09-16T07:31:54.100 INFO:teuthology.orchestra.run.smithi151.stdout:5.14.0-505.el9.x86_64 2024-09-16T07:31:54.100 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T07:31:54.100 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T07:31:54.100 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T07:31:55.101 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T07:31:55.101 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T07:31:55.208 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2024-09-16T07:31:55.231 DEBUG:teuthology.parallel:result is None 2024-09-16T07:31:55.232 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T07:31:55.239 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T07:31:55.239 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T07:31:55.254 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T07:31:55.261 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T07:31:55.271 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T07:31:55.271 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T07:31:55.326 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T07:31:55.332 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T07:31:55.332 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T07:31:55.390 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:31:55.400 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:31:55.402 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T07:31:55.409 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T07:31:55.409 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T07:31:55.467 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T07:31:55.477 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T07:31:55.477 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T07:31:55.523 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:31:55.609 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:31:55.652 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:31:55.735 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:31:55.775 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:31:55.775 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T07:31:55.840 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2024-09-16T07:31:55.930 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T07:31:56.216 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T07:31:56.229 INFO:teuthology.task.internal:Starting timer... 2024-09-16T07:31:56.230 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T07:31:56.254 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T07:31:56.269 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-16T07:31:56.269 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2024-09-16T07:31:56.329 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2024-09-16T07:31:56.331 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T07:31:56.331 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2024-09-16T07:31:56.361 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2024-09-16T07:31:56.362 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2024-09-16T07:31:56.362 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T07:31:56.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:31:56.427 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T07:31:56.428 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2024-09-16T07:31:56.508 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T07:31:56.516 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-16T07:31:56.519 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-16T07:31:56.646 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T07:31:56.661 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T07:31:56.663 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T07:35:39.289 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2024-09-16T07:35:39.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-16T07:35:39.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:35:39.375 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-09-16T07:35:39.447 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-16T07:35:39.448 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T07:35:39.459 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T07:35:39.459 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T07:35:39.459 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:35:39.517 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T07:35:39.531 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T07:35:39.555 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2024-09-16T07:35:39.567 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2024-09-16T07:35:39.581 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T07:35:39.595 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T07:35:39.655 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2024-09-16T07:35:39.659 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T07:35:39.659 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2024-09-16T07:35:39.659 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:35:39.659 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:35:39.659 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:35:39.659 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:35:39.660 INFO:teuthology.run_tasks:Running task install... 2024-09-16T07:35:39.668 DEBUG:teuthology.task.install:project ceph 2024-09-16T07:35:39.668 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}} 2024-09-16T07:35:39.668 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'} 2024-09-16T07:35:39.668 INFO:teuthology.task.install:Using flavor: crimson 2024-09-16T07:35:39.674 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T07:35:39.674 INFO:teuthology.task.install:extra packages: [] 2024-09-16T07:35:39.675 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T07:35:39.675 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:35:39.828 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T07:35:39.828 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T07:35:39.938 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T07:35:39.938 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:35:39.938 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T07:35:39.965 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T07:35:39.965 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T07:35:40.031 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T07:35:40.106 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T07:35:40.171 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2024-09-16T07:35:40.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2024-09-16T07:35:40.410 INFO:teuthology.orchestra.run.smithi151.stdout:45 files removed 2024-09-16T07:35:40.438 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw 2024-09-16T07:35:41.116 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 226 kB/s | 88 kB 00:00 2024-09-16T07:35:41.634 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 51 kB/s | 24 kB 00:00 2024-09-16T07:35:41.952 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 7.4 kB/s | 2.1 kB 00:00 2024-09-16T07:35:43.877 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-09-16T07:35:47.287 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 20 MB 00:02 2024-09-16T07:35:53.371 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.5 MB 00:02 2024-09-16T07:35:54.939 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-16T07:35:55.735 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-16T07:36:01.175 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-16T07:36:03.576 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:36:03.579 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:36:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-09-16T07:36:03.580 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:36:03.580 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:36:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T07:36:03.580 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2024-09-16T07:36:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:36:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T07:36:03.580 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-09-16T07:36:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T07:36:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T07:36:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T07:36:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T07:36:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T07:36:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T07:36:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T07:36:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T07:36:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T07:36:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T07:36:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T07:36:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T07:36:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T07:36:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T07:36:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T07:36:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T07:36:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T07:36:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T07:36:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T07:36:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T07:36:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T07:36:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T07:36:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T07:36:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T07:36:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T07:36:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T07:36:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T07:36:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T07:36:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T07:36:03.582 INFO:teuthology.orchestra.run.smithi151.stdout:Installing weak dependencies: 2024-09-16T07:36:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T07:36:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:36:03.583 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:36:03.583 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:36:03.583 INFO:teuthology.orchestra.run.smithi151.stdout:Install 31 Packages 2024-09-16T07:36:03.583 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 2 Packages 2024-09-16T07:36:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:36:03.583 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 60 M 2024-09-16T07:36:03.584 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:36:05.010 INFO:teuthology.orchestra.run.smithi151.stdout:(1/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 7.5 MB/s | 10 MB 00:01 2024-09-16T07:36:05.052 INFO:teuthology.orchestra.run.smithi151.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 605 kB/s | 25 kB 00:00 2024-09-16T07:36:05.169 INFO:teuthology.orchestra.run.smithi151.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 6.8 MB/s | 809 kB 00:00 2024-09-16T07:36:05.252 INFO:teuthology.orchestra.run.smithi151.stdout:(4/33): libradosstriper1-19.3.0-4879.g81fedcb3. 6.5 MB/s | 558 kB 00:00 2024-09-16T07:36:05.503 INFO:teuthology.orchestra.run.smithi151.stdout:(5/33): ceph-common-19.3.0-4879.g81fedcb3.el9.x 11 MB/s | 20 MB 00:01 2024-09-16T07:36:05.545 INFO:teuthology.orchestra.run.smithi151.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 1.1 MB/s | 45 kB 00:00 2024-09-16T07:36:05.595 INFO:teuthology.orchestra.run.smithi151.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 2.8 MB/s | 143 kB 00:00 2024-09-16T07:36:05.654 INFO:teuthology.orchestra.run.smithi151.stdout:(8/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 2.7 MB/s | 160 kB 00:00 2024-09-16T07:36:05.729 INFO:teuthology.orchestra.run.smithi151.stdout:(9/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 11 MB/s | 5.4 MB 00:00 2024-09-16T07:36:05.763 INFO:teuthology.orchestra.run.smithi151.stdout:(10/33): python3-rados-19.3.0-4879.g81fedcb3.el 2.8 MB/s | 315 kB 00:00 2024-09-16T07:36:05.797 INFO:teuthology.orchestra.run.smithi151.stdout:(11/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 5.0 MB/s | 302 kB 00:00 2024-09-16T07:36:05.822 INFO:teuthology.orchestra.run.smithi151.stdout:(12/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 1.7 MB/s | 99 kB 00:00 2024-09-16T07:36:06.215 INFO:teuthology.orchestra.run.smithi151.stdout:(13/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x8 2.3 MB/s | 6.1 MB 00:02 2024-09-16T07:36:06.256 INFO:teuthology.orchestra.run.smithi151.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 233 kB/s | 107 kB 00:00 2024-09-16T07:36:06.368 INFO:teuthology.orchestra.run.smithi151.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-16T07:36:06.490 INFO:teuthology.orchestra.run.smithi151.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 255 kB/s | 171 kB 00:00 2024-09-16T07:36:06.699 INFO:teuthology.orchestra.run.smithi151.stdout:(17/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-09-16T07:36:06.758 INFO:teuthology.orchestra.run.smithi151.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 1.6 MB/s | 662 kB 00:00 2024-09-16T07:36:06.783 INFO:teuthology.orchestra.run.smithi151.stdout:(19/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 282 kB/s | 160 kB 00:00 2024-09-16T07:36:06.817 INFO:teuthology.orchestra.run.smithi151.stdout:(20/33): python3-prettytable-0.7.2-27.el9.noarc 359 kB/s | 42 kB 00:00 2024-09-16T07:36:06.892 INFO:teuthology.orchestra.run.smithi151.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-09-16T07:36:06.918 INFO:teuthology.orchestra.run.smithi151.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 267 kB/s | 36 kB 00:00 2024-09-16T07:36:06.943 INFO:teuthology.orchestra.run.smithi151.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 377 kB/s | 47 kB 00:00 2024-09-16T07:36:07.002 INFO:teuthology.orchestra.run.smithi151.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-16T07:36:07.027 INFO:teuthology.orchestra.run.smithi151.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-16T07:36:07.053 INFO:teuthology.orchestra.run.smithi151.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 277 kB/s | 26 kB 00:00 2024-09-16T07:36:07.078 INFO:teuthology.orchestra.run.smithi151.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-16T07:36:07.103 INFO:teuthology.orchestra.run.smithi151.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-16T07:36:07.162 INFO:teuthology.orchestra.run.smithi151.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-16T07:36:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-16T07:36:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-16T07:36:07.413 INFO:teuthology.orchestra.run.smithi151.stdout:(32/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 14 MB/s | 3.5 MB 00:00 2024-09-16T07:36:07.622 INFO:teuthology.orchestra.run.smithi151.stdout:(33/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 9.3 MB/s | 3.8 MB 00:00 2024-09-16T07:36:07.627 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:36:07.627 INFO:teuthology.orchestra.run.smithi151.stdout:Total 15 MB/s | 60 MB 00:04 2024-09-16T07:36:07.744 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:36:07.782 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:36:07.782 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:36:08.455 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:36:08.455 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:36:10.053 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:36:10.592 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T07:36:10.641 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:36:10.733 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:36:10.830 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:36:10.860 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:36:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:36:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T07:36:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T07:36:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T07:36:11.073 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:36:11.094 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:36:11.292 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:36:11.321 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:36:11.366 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T07:36:11.417 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T07:36:11.446 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:36:11.525 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T07:36:11.552 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:36:11.641 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:36:11.688 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T07:36:11.799 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T07:36:11.837 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T07:36:11.878 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T07:36:11.911 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T07:36:11.940 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T07:36:11.977 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T07:36:12.356 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T07:36:12.411 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:36:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:36:12.533 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T07:36:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T07:36:13.165 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T07:36:13.198 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:36:13.270 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:36:13.348 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T07:36:13.401 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T07:36:15.922 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:36:15.958 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:36:16.681 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:36:16.734 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:36:17.085 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:36:17.085 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T07:36:17.085 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T07:36:17.085 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:36:17.128 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:36:27.590 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:36:27.591 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2024-09-16T07:36:27.591 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2024-09-16T07:36:27.591 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2024-09-16T07:36:27.591 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2024-09-16T07:36:27.591 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2024-09-16T07:36:27.591 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /root 2024-09-16T07:36:27.591 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2024-09-16T07:36:27.591 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:36:28.727 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:36:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:36:28.755 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:36:28.755 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T07:36:28.755 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:36:28.755 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:36:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:36:28.757 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:36:28.847 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:36:28.847 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:36:30.169 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:36:30.169 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T07:36:30.169 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:36:30.169 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:36:30.169 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:36:30.169 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T07:36:30.169 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T07:36:30.169 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T07:36:30.170 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T07:36:30.170 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T07:36:30.170 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T07:36:30.170 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T07:36:30.170 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:36:30.170 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T07:36:30.170 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T07:36:30.170 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T07:36:30.170 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T07:36:30.170 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T07:36:30.170 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T07:36:30.170 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T07:36:30.170 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T07:36:30.171 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T07:36:30.171 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T07:36:30.171 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T07:36:30.171 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T07:36:30.171 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T07:36:30.171 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T07:36:30.171 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T07:36:30.171 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T07:36:30.171 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T07:36:30.171 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T07:36:30.171 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T07:36:30.171 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:36:30.172 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T07:36:30.172 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T07:36:31.157 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:36:31.157 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:36:31.157 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2024-09-16T07:36:31.157 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:31.158 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:31.158 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:36:31.158 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T07:36:31.158 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:31.158 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:31.158 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:31.158 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:31.158 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T07:36:31.158 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T07:36:31.158 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T07:36:31.158 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:31.158 INFO:teuthology.orchestra.run.smithi151.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T07:36:31.158 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T07:36:31.158 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T07:36:31.159 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T07:36:31.159 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:31.159 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T07:36:31.159 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:31.159 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T07:36:31.159 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T07:36:31.159 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T07:36:31.159 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:31.159 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:31.159 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:31.159 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T07:36:31.159 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:31.159 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:31.160 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:31.160 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T07:36:31.160 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T07:36:31.160 INFO:teuthology.orchestra.run.smithi151.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T07:36:31.160 INFO:teuthology.orchestra.run.smithi151.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T07:36:31.160 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T07:36:31.160 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:36:31.160 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:36:31.545 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-test 2024-09-16T07:36:32.115 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:00:31 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:36:32.260 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:36:32.261 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:36:32.261 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-09-16T07:36:32.261 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:36:32.261 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:36:32.261 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T07:36:32.261 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-09-16T07:36:32.261 INFO:teuthology.orchestra.run.smithi151.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T07:36:32.262 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T07:36:32.262 INFO:teuthology.orchestra.run.smithi151.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T07:36:32.262 INFO:teuthology.orchestra.run.smithi151.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T07:36:32.262 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T07:36:32.262 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T07:36:32.262 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T07:36:32.262 INFO:teuthology.orchestra.run.smithi151.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T07:36:32.262 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:36:32.262 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:36:32.262 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:36:32.262 INFO:teuthology.orchestra.run.smithi151.stdout:Install 9 Packages 2024-09-16T07:36:32.263 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:36:32.263 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 87 M 2024-09-16T07:36:32.263 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 797 M 2024-09-16T07:36:32.263 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:36:32.665 INFO:teuthology.orchestra.run.smithi151.stdout:(1/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 768 kB/s | 175 kB 00:00 2024-09-16T07:36:32.899 INFO:teuthology.orchestra.run.smithi151.stdout:(2/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 204 kB/s | 94 kB 00:00 2024-09-16T07:36:33.100 INFO:teuthology.orchestra.run.smithi151.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 913 kB/s | 183 kB 00:00 2024-09-16T07:36:33.392 INFO:teuthology.orchestra.run.smithi151.stdout:(4/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 708 kB/s | 513 kB 00:00 2024-09-16T07:36:33.525 INFO:teuthology.orchestra.run.smithi151.stdout:(5/9): protobuf-3.14.0-13.el9.x86_64.rpm 2.4 MB/s | 1.0 MB 00:00 2024-09-16T07:36:33.642 INFO:teuthology.orchestra.run.smithi151.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 546 kB/s | 64 kB 00:00 2024-09-16T07:36:33.667 INFO:teuthology.orchestra.run.smithi151.stdout:(7/9): socat-1.7.4.1-6.el9.x86_64.rpm 1.1 MB/s | 304 kB 00:00 2024-09-16T07:36:33.710 INFO:teuthology.orchestra.run.smithi151.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.8 MB/s | 122 kB 00:00 2024-09-16T07:36:34.860 INFO:teuthology.orchestra.run.smithi151.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 35 MB/s | 85 MB 00:02 2024-09-16T07:36:34.862 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:36:34.863 INFO:teuthology.orchestra.run.smithi151.stdout:Total 33 MB/s | 87 MB 00:02 2024-09-16T07:36:34.947 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:36:34.970 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:36:34.970 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:36:35.594 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:36:35.594 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:36:36.477 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:36:36.561 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T07:36:36.611 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T07:36:36.664 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T07:36:36.692 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T07:36:36.723 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:36:36.756 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:36:36.819 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:36:36.866 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T07:36:36.892 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:36:48.111 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:36:48.191 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:36:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:36:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T07:36:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T07:36:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T07:36:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T07:36:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:36:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T07:36:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T07:36:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T07:36:55.364 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T07:36:55.364 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:36:55.364 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:36:55.364 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:55.364 INFO:teuthology.orchestra.run.smithi151.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T07:36:55.364 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:55.364 INFO:teuthology.orchestra.run.smithi151.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T07:36:55.364 INFO:teuthology.orchestra.run.smithi151.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T07:36:55.364 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T07:36:55.365 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T07:36:55.365 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T07:36:55.365 INFO:teuthology.orchestra.run.smithi151.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T07:36:55.365 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:36:55.365 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:36:55.687 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph 2024-09-16T07:36:56.254 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:00:55 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:36:56.394 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:36:56.397 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:36:56.397 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-09-16T07:36:56.397 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:36:56.397 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:36:56.397 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T07:36:56.397 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-09-16T07:36:56.398 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T07:36:56.398 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T07:36:56.398 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T07:36:56.398 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T07:36:56.398 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T07:36:56.398 INFO:teuthology.orchestra.run.smithi151.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T07:36:56.398 INFO:teuthology.orchestra.run.smithi151.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T07:36:56.398 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T07:36:56.398 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T07:36:56.398 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T07:36:56.398 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T07:36:56.398 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T07:36:56.398 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T07:36:56.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T07:36:56.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T07:36:56.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections 2024-09-16T07:36:56.399 INFO:teuthology.orchestra.run.smithi151.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T07:36:56.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T07:36:56.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T07:36:56.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T07:36:56.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T07:36:56.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T07:36:56.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T07:36:56.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T07:36:56.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T07:36:56.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T07:36:56.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T07:36:56.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T07:36:56.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T07:36:56.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T07:36:56.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T07:36:56.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T07:36:56.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T07:36:56.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T07:36:56.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T07:36:56.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T07:36:56.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T07:36:56.401 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:36:56.401 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:36:56.401 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:36:56.401 INFO:teuthology.orchestra.run.smithi151.stdout:Install 37 Packages 2024-09-16T07:36:56.401 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:36:56.401 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 84 M 2024-09-16T07:36:56.402 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 897 M 2024-09-16T07:36:56.402 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:36:57.204 INFO:teuthology.orchestra.run.smithi151.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 30 kB/s | 6.5 kB 00:00 2024-09-16T07:36:57.379 INFO:teuthology.orchestra.run.smithi151.stdout:(2/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 5.5 MB/s | 2.2 MB 00:00 2024-09-16T07:36:57.421 INFO:teuthology.orchestra.run.smithi151.stdout:(3/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 3.6 MB/s | 1.6 MB 00:00 2024-09-16T07:36:57.497 INFO:teuthology.orchestra.run.smithi151.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 3.8 MB/s | 291 kB 00:00 2024-09-16T07:36:57.673 INFO:teuthology.orchestra.run.smithi151.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-16T07:36:57.798 INFO:teuthology.orchestra.run.smithi151.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 9.8 MB/s | 1.2 MB 00:00 2024-09-16T07:36:57.848 INFO:teuthology.orchestra.run.smithi151.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-16T07:36:57.949 INFO:teuthology.orchestra.run.smithi151.stdout:(8/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86_ 6.9 MB/s | 5.1 MB 00:00 2024-09-16T07:36:57.974 INFO:teuthology.orchestra.run.smithi151.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-16T07:36:58.024 INFO:teuthology.orchestra.run.smithi151.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-16T07:36:58.091 INFO:teuthology.orchestra.run.smithi151.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 877 kB/s | 125 kB 00:00 2024-09-16T07:36:58.150 INFO:teuthology.orchestra.run.smithi151.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-16T07:36:58.184 INFO:teuthology.orchestra.run.smithi151.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 1.0 MB/s | 35 kB 00:00 2024-09-16T07:36:58.226 INFO:teuthology.orchestra.run.smithi151.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-09-16T07:36:58.259 INFO:teuthology.orchestra.run.smithi151.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-16T07:36:58.277 INFO:teuthology.orchestra.run.smithi151.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-16T07:36:58.293 INFO:teuthology.orchestra.run.smithi151.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-16T07:36:58.310 INFO:teuthology.orchestra.run.smithi151.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 664 kB/s | 22 kB 00:00 2024-09-16T07:36:58.353 INFO:teuthology.orchestra.run.smithi151.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-16T07:36:58.370 INFO:teuthology.orchestra.run.smithi151.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 738 kB/s | 43 kB 00:00 2024-09-16T07:36:58.395 INFO:teuthology.orchestra.run.smithi151.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 4.2 MB/s | 172 kB 00:00 2024-09-16T07:36:58.412 INFO:teuthology.orchestra.run.smithi151.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 641 kB/s | 11 kB 00:00 2024-09-16T07:36:58.437 INFO:teuthology.orchestra.run.smithi151.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 705 kB/s | 18 kB 00:00 2024-09-16T07:36:58.463 INFO:teuthology.orchestra.run.smithi151.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 929 kB/s | 23 kB 00:00 2024-09-16T07:36:58.488 INFO:teuthology.orchestra.run.smithi151.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 769 kB/s | 19 kB 00:00 2024-09-16T07:36:58.511 INFO:teuthology.orchestra.run.smithi151.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 895 kB/s | 20 kB 00:00 2024-09-16T07:36:58.536 INFO:teuthology.orchestra.run.smithi151.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.1 MB/s | 358 kB 00:00 2024-09-16T07:36:58.553 INFO:teuthology.orchestra.run.smithi151.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2024-09-16T07:36:58.579 INFO:teuthology.orchestra.run.smithi151.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-09-16T07:36:58.595 INFO:teuthology.orchestra.run.smithi151.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 997 kB/s | 16 kB 00:00 2024-09-16T07:36:58.621 INFO:teuthology.orchestra.run.smithi151.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-16T07:36:58.646 INFO:teuthology.orchestra.run.smithi151.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-16T07:36:58.672 INFO:teuthology.orchestra.run.smithi151.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 709 kB/s | 36 kB 00:00 2024-09-16T07:36:58.697 INFO:teuthology.orchestra.run.smithi151.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-16T07:36:58.722 INFO:teuthology.orchestra.run.smithi151.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 797 kB/s | 20 kB 00:00 2024-09-16T07:36:58.748 INFO:teuthology.orchestra.run.smithi151.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-16T07:37:00.373 INFO:teuthology.orchestra.run.smithi151.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 24 MB/s | 70 MB 00:02 2024-09-16T07:37:00.377 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:37:00.378 INFO:teuthology.orchestra.run.smithi151.stdout:Total 21 MB/s | 84 MB 00:03 2024-09-16T07:37:00.540 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:37:00.583 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:37:00.584 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:37:01.383 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:37:01.383 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:37:03.062 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:37:03.135 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T07:37:03.168 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T07:37:03.196 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T07:37:03.268 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T07:37:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T07:37:03.353 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T07:37:03.456 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T07:37:03.542 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T07:37:03.599 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T07:37:03.642 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T07:37:03.672 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T07:37:03.707 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T07:37:03.740 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T07:37:03.806 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T07:37:03.850 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T07:37:03.884 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T07:37:03.967 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T07:37:04.015 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T07:37:04.107 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T07:37:04.250 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T07:37:04.335 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T07:37:04.387 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T07:37:04.433 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T07:37:04.499 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T07:37:04.556 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T07:37:04.756 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T07:37:04.805 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T07:37:04.885 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T07:37:04.974 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T07:37:05.017 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T07:37:05.145 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T07:37:05.343 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T07:37:05.374 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:37:05.401 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:37:05.401 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:37:05.401 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T07:37:05.401 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:37:05.401 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:37:05.402 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:16.025 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:37:16.053 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:37:16.053 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:37:16.053 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T07:37:16.053 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:37:16.053 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:37:16.053 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:16.601 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:37:16.624 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:37:16.625 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:37:16.625 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T07:37:16.625 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:37:16.625 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:37:16.625 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:16.861 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:37:16.883 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:37:16.883 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:37:16.883 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T07:37:16.884 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:37:16.884 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:37:16.884 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:16.948 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:37:23.710 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:37:23.710 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T07:37:23.710 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T07:37:23.710 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T07:37:23.710 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T07:37:23.710 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T07:37:23.711 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T07:37:23.711 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T07:37:23.711 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T07:37:23.711 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T07:37:23.711 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T07:37:23.711 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T07:37:23.711 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T07:37:23.711 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T07:37:23.712 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T07:37:23.712 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T07:37:23.712 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T07:37:23.712 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T07:37:23.713 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T07:37:23.713 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T07:37:23.713 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T07:37:23.713 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T07:37:23.713 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T07:37:23.713 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T07:37:23.713 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T07:37:23.713 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T07:37:23.714 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T07:37:23.714 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T07:37:23.714 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T07:37:23.715 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T07:37:23.715 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T07:37:23.715 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T07:37:23.715 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T07:37:23.715 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T07:37:23.715 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T07:37:23.715 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T07:37:23.715 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T07:37:24.635 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T07:37:24.635 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:24.635 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:37:24.635 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:24.635 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:24.635 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:24.635 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:37:24.635 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:24.636 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:24.636 INFO:teuthology.orchestra.run.smithi151.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T07:37:24.636 INFO:teuthology.orchestra.run.smithi151.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T07:37:24.636 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T07:37:24.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T07:37:24.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T07:37:24.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T07:37:24.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T07:37:24.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T07:37:24.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T07:37:24.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T07:37:24.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T07:37:24.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T07:37:24.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T07:37:24.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T07:37:24.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T07:37:24.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T07:37:24.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T07:37:24.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T07:37:24.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T07:37:24.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T07:37:24.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T07:37:24.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T07:37:24.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T07:37:24.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T07:37:24.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T07:37:24.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T07:37:24.638 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T07:37:24.638 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T07:37:24.638 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T07:37:24.638 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T07:37:24.638 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T07:37:24.638 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:37:24.937 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-base 2024-09-16T07:37:25.535 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:24 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:37:25.632 INFO:teuthology.orchestra.run.smithi151.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:37:25.676 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:37:25.677 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-09-16T07:37:25.677 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:37:25.779 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install cephadm 2024-09-16T07:37:26.356 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:25 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:37:26.488 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:37:26.489 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:37:26.489 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-09-16T07:37:26.489 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:37:26.489 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:37:26.489 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T07:37:26.489 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:26.489 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:37:26.489 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:37:26.489 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2024-09-16T07:37:26.489 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:26.489 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 785 k 2024-09-16T07:37:26.489 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 791 k 2024-09-16T07:37:26.489 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:37:26.774 INFO:teuthology.orchestra.run.smithi151.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 2.7 MB/s | 785 kB 00:00 2024-09-16T07:37:26.775 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:37:26.775 INFO:teuthology.orchestra.run.smithi151.stdout:Total 2.7 MB/s | 785 kB 00:00 2024-09-16T07:37:26.775 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:37:26.780 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:37:26.780 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:37:26.786 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:37:26.786 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:37:26.859 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:37:27.337 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:37:27.445 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:37:27.871 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:37:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:37:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:28.107 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:37:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:37:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:28.108 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:37:28.334 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T07:37:28.904 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:27 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:37:29.042 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:37:29.043 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:37:29.043 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repo Size 2024-09-16T07:37:29.043 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:37:29.043 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:37:29.043 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T07:37:29.043 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:29.043 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:37:29.043 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:37:29.043 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2024-09-16T07:37:29.043 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:29.043 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 158 k 2024-09-16T07:37:29.043 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 644 k 2024-09-16T07:37:29.044 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:37:29.235 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 825 kB/s | 158 kB 00:00 2024-09-16T07:37:29.236 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:37:29.236 INFO:teuthology.orchestra.run.smithi151.stdout:Total 818 kB/s | 158 kB 00:00 2024-09-16T07:37:29.236 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:37:29.246 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:37:29.246 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:37:29.304 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:37:29.304 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:37:29.448 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:37:29.520 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:37:29.545 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:37:29.545 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:37:29.545 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T07:37:29.546 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:37:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:30.509 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:37:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:30.510 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:37:30.736 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-mgr 2024-09-16T07:37:31.313 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:30 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:37:31.409 INFO:teuthology.orchestra.run.smithi151.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:37:31.452 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:37:31.453 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-09-16T07:37:31.453 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:37:31.529 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T07:37:32.090 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:31 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:37:32.223 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:37:32.224 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:37:32.224 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-09-16T07:37:32.224 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:37:32.224 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:37:32.224 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T07:37:32.224 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-09-16T07:37:32.224 INFO:teuthology.orchestra.run.smithi151.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T07:37:32.224 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T07:37:32.224 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T07:37:32.224 INFO:teuthology.orchestra.run.smithi151.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T07:37:32.225 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T07:37:32.225 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T07:37:32.225 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T07:37:32.225 INFO:teuthology.orchestra.run.smithi151.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T07:37:32.225 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T07:37:32.225 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T07:37:32.225 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:32.225 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:37:32.225 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:37:32.225 INFO:teuthology.orchestra.run.smithi151.stdout:Install 11 Packages 2024-09-16T07:37:32.225 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:32.226 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 18 M 2024-09-16T07:37:32.226 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 155 M 2024-09-16T07:37:32.226 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:37:32.618 INFO:teuthology.orchestra.run.smithi151.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4879.g81 187 kB/s | 34 kB 00:00 2024-09-16T07:37:32.643 INFO:teuthology.orchestra.run.smithi151.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4879.g81f 79 kB/s | 16 kB 00:00 2024-09-16T07:37:32.802 INFO:teuthology.orchestra.run.smithi151.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 5.3 MB/s | 863 kB 00:00 2024-09-16T07:37:32.884 INFO:teuthology.orchestra.run.smithi151.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 6.6 MB/s | 548 kB 00:00 2024-09-16T07:37:32.911 INFO:teuthology.orchestra.run.smithi151.stdout:(5/11): python3-protobuf-3.14.0-13.el9.noarch.r 920 kB/s | 269 kB 00:00 2024-09-16T07:37:32.937 INFO:teuthology.orchestra.run.smithi151.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 367 kB/s | 19 kB 00:00 2024-09-16T07:37:32.970 INFO:teuthology.orchestra.run.smithi151.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.3 MB/s | 144 kB 00:00 2024-09-16T07:37:32.995 INFO:teuthology.orchestra.run.smithi151.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.3 MB/s | 31 kB 00:00 2024-09-16T07:37:33.030 INFO:teuthology.orchestra.run.smithi151.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-16T07:37:33.097 INFO:teuthology.orchestra.run.smithi151.stdout:(10/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2024-09-16T07:37:33.322 INFO:teuthology.orchestra.run.smithi151.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 16 MB/s | 14 MB 00:00 2024-09-16T07:37:33.326 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:37:33.326 INFO:teuthology.orchestra.run.smithi151.stdout:Total 17 MB/s | 18 MB 00:01 2024-09-16T07:37:33.357 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:37:33.375 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:37:33.376 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:37:33.636 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:37:33.637 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:37:34.186 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:37:34.278 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T07:37:34.317 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T07:37:34.408 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T07:37:34.536 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T07:37:34.589 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T07:37:34.672 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T07:37:34.725 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T07:37:34.762 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:37:34.794 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T07:37:38.004 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T07:37:38.059 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:37:40.164 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:37:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T07:37:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T07:37:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T07:37:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T07:37:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T07:37:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T07:37:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T07:37:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:37:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T07:37:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T07:37:40.475 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T07:37:40.475 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:40.476 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:37:40.476 INFO:teuthology.orchestra.run.smithi151.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T07:37:40.476 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:37:40.476 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:37:40.476 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:37:40.476 INFO:teuthology.orchestra.run.smithi151.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T07:37:40.476 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T07:37:40.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T07:37:40.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T07:37:40.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T07:37:40.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T07:37:40.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T07:37:40.476 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:40.477 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:37:40.772 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T07:37:41.339 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:40 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:37:41.473 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:37:41.474 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================= 2024-09-16T07:37:41.474 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-09-16T07:37:41.475 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================= 2024-09-16T07:37:41.475 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:37:41.475 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T07:37:41.475 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-09-16T07:37:41.475 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T07:37:41.475 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T07:37:41.475 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T07:37:41.475 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T07:37:41.475 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T07:37:41.475 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T07:37:41.475 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T07:37:41.475 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T07:37:41.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T07:37:41.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T07:37:41.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T07:37:41.476 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:41.476 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:37:41.476 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================= 2024-09-16T07:37:41.476 INFO:teuthology.orchestra.run.smithi151.stdout:Install 12 Packages 2024-09-16T07:37:41.476 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:41.477 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 38 M 2024-09-16T07:37:41.477 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 212 M 2024-09-16T07:37:41.477 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:37:41.935 INFO:teuthology.orchestra.run.smithi151.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-16T07:37:41.968 INFO:teuthology.orchestra.run.smithi151.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.7 MB/s | 801 kB 00:00 2024-09-16T07:37:42.019 INFO:teuthology.orchestra.run.smithi151.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-09-16T07:37:42.061 INFO:teuthology.orchestra.run.smithi151.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 437 kB/s | 18 kB 00:00 2024-09-16T07:37:42.120 INFO:teuthology.orchestra.run.smithi151.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-16T07:37:42.270 INFO:teuthology.orchestra.run.smithi151.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-48 16 MB/s | 7.4 MB 00:00 2024-09-16T07:37:42.362 INFO:teuthology.orchestra.run.smithi151.stdout:(7/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 20 MB/s | 4.9 MB 00:00 2024-09-16T07:37:42.454 INFO:teuthology.orchestra.run.smithi151.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.3 MB/s | 245 kB 00:00 2024-09-16T07:37:42.521 INFO:teuthology.orchestra.run.smithi151.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-09-16T07:37:42.546 INFO:teuthology.orchestra.run.smithi151.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.7 MB/s | 250 kB 00:00 2024-09-16T07:37:42.905 INFO:teuthology.orchestra.run.smithi151.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-09-16T07:37:42.955 INFO:teuthology.orchestra.run.smithi151.stdout:(12/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 3.0 MB/s | 3.0 MB 00:00 2024-09-16T07:37:42.956 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:37:42.957 INFO:teuthology.orchestra.run.smithi151.stdout:Total 26 MB/s | 38 MB 00:01 2024-09-16T07:37:43.309 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:37:43.335 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:37:43.335 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:37:43.773 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:37:43.773 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:37:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:37:44.615 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T07:37:44.654 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:37:44.758 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:37:44.789 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T07:37:44.975 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T07:37:45.004 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T07:37:45.090 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T07:37:45.772 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T07:37:45.914 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T07:37:47.173 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:37:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T07:37:48.243 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:37:50.880 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:37:50.880 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T07:37:50.880 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:37:50.880 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:37:50.880 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T07:37:50.880 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T07:37:50.881 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T07:37:50.881 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T07:37:50.881 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T07:37:50.881 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T07:37:50.881 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:37:50.881 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T07:37:51.275 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T07:37:51.275 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:51.275 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:37:51.275 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:37:51.276 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T07:37:51.276 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T07:37:51.276 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T07:37:51.276 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T07:37:51.276 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T07:37:51.276 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T07:37:51.276 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T07:37:51.276 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T07:37:51.276 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T07:37:51.276 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T07:37:51.276 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T07:37:51.277 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:51.277 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:37:51.675 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-mgr-rook 2024-09-16T07:37:52.261 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:51 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:37:52.397 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:37:52.398 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:37:52.398 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-09-16T07:37:52.398 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:37:52.399 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:37:52.399 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T07:37:52.399 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-09-16T07:37:52.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T07:37:52.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T07:37:52.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T07:37:52.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T07:37:52.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T07:37:52.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T07:37:52.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T07:37:52.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T07:37:52.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T07:37:52.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T07:37:52.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T07:37:52.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T07:37:52.400 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:52.400 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:37:52.400 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:37:52.400 INFO:teuthology.orchestra.run.smithi151.stdout:Install 13 Packages 2024-09-16T07:37:52.400 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:52.401 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 2.2 M 2024-09-16T07:37:52.401 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 26 M 2024-09-16T07:37:52.401 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:37:52.582 INFO:teuthology.orchestra.run.smithi151.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 188 kB/s | 19 kB 00:00 2024-09-16T07:37:52.599 INFO:teuthology.orchestra.run.smithi151.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 215 kB/s | 26 kB 00:00 2024-09-16T07:37:52.633 INFO:teuthology.orchestra.run.smithi151.stdout:(3/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 322 kB/s | 49 kB 00:00 2024-09-16T07:37:52.725 INFO:teuthology.orchestra.run.smithi151.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-16T07:37:52.750 INFO:teuthology.orchestra.run.smithi151.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.3 MB/s | 222 kB 00:00 2024-09-16T07:37:52.767 INFO:teuthology.orchestra.run.smithi151.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.2 MB/s | 54 kB 00:00 2024-09-16T07:37:52.801 INFO:teuthology.orchestra.run.smithi151.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 639 kB/s | 32 kB 00:00 2024-09-16T07:37:52.826 INFO:teuthology.orchestra.run.smithi151.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-16T07:37:52.843 INFO:teuthology.orchestra.run.smithi151.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 186 kB/s | 14 kB 00:00 2024-09-16T07:37:52.868 INFO:teuthology.orchestra.run.smithi151.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 3.2 MB/s | 59 kB 00:00 2024-09-16T07:37:52.894 INFO:teuthology.orchestra.run.smithi151.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-09-16T07:37:52.919 INFO:teuthology.orchestra.run.smithi151.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-16T07:37:52.970 INFO:teuthology.orchestra.run.smithi151.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.1 MB/s | 1.0 MB 00:00 2024-09-16T07:37:52.972 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:37:52.973 INFO:teuthology.orchestra.run.smithi151.stdout:Total 3.9 MB/s | 2.2 MB 00:00 2024-09-16T07:37:53.036 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:37:53.051 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:37:53.051 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:37:53.140 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:37:53.140 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:37:53.638 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:37:53.811 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T07:37:53.863 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T07:37:53.918 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T07:37:53.956 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T07:37:53.998 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T07:37:54.099 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T07:37:54.210 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T07:37:54.259 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T07:37:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T07:37:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T07:37:55.065 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T07:37:55.114 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T07:37:55.136 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:37:55.963 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:37:55.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T07:37:55.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T07:37:55.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T07:37:55.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T07:37:55.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T07:37:55.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T07:37:55.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T07:37:55.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T07:37:55.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T07:37:55.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T07:37:55.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T07:37:55.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T07:37:56.296 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T07:37:56.296 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:56.296 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:37:56.297 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:37:56.297 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T07:37:56.297 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T07:37:56.297 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T07:37:56.297 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T07:37:56.297 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T07:37:56.297 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T07:37:56.297 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T07:37:56.297 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T07:37:56.297 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T07:37:56.297 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T07:37:56.297 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T07:37:56.298 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T07:37:56.298 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:56.298 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:37:56.582 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T07:37:57.154 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:56 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:37:57.288 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:37:57.289 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:37:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-09-16T07:37:57.289 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:37:57.289 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:37:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T07:37:57.289 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-09-16T07:37:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T07:37:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T07:37:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T07:37:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T07:37:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T07:37:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:57.290 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:37:57.290 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:37:57.290 INFO:teuthology.orchestra.run.smithi151.stdout:Install 6 Packages 2024-09-16T07:37:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:37:57.291 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 7.0 M 2024-09-16T07:37:57.291 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 33 M 2024-09-16T07:37:57.291 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:37:57.745 INFO:teuthology.orchestra.run.smithi151.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 624 kB/s | 154 kB 00:00 2024-09-16T07:37:57.770 INFO:teuthology.orchestra.run.smithi151.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 910 kB/s | 248 kB 00:00 2024-09-16T07:37:57.821 INFO:teuthology.orchestra.run.smithi151.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-16T07:37:57.848 INFO:teuthology.orchestra.run.smithi151.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 743 kB/s | 58 kB 00:00 2024-09-16T07:37:57.873 INFO:teuthology.orchestra.run.smithi151.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-16T07:38:00.015 INFO:teuthology.orchestra.run.smithi151.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.4 MB/s | 6.0 MB 00:02 2024-09-16T07:38:00.017 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:00.017 INFO:teuthology.orchestra.run.smithi151.stdout:Total 2.6 MB/s | 7.0 MB 00:02 2024-09-16T07:38:00.088 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:38:00.099 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:38:00.099 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:38:00.200 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:38:00.200 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:38:00.511 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:38:00.688 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T07:38:00.733 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T07:38:01.255 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T07:38:01.336 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T07:38:01.403 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T07:38:01.428 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:38:02.239 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:38:02.239 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T07:38:02.239 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T07:38:02.239 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T07:38:02.239 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T07:38:02.239 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T07:38:02.512 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T07:38:02.513 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:02.513 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:38:02.513 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:02.513 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T07:38:02.513 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T07:38:02.513 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T07:38:02.513 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T07:38:02.513 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T07:38:02.513 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:02.513 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:38:02.813 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-fuse 2024-09-16T07:38:03.384 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:02 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:38:03.518 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:38:03.519 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:03.519 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-09-16T07:38:03.519 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:03.519 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:38:03.519 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T07:38:03.519 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-09-16T07:38:03.519 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T07:38:03.519 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:03.519 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:38:03.519 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:03.519 INFO:teuthology.orchestra.run.smithi151.stdout:Install 2 Packages 2024-09-16T07:38:03.519 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:03.520 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 964 k 2024-09-16T07:38:03.520 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 4.1 M 2024-09-16T07:38:03.520 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:38:03.791 INFO:teuthology.orchestra.run.smithi151.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 578 kB/s | 80 kB 00:00 2024-09-16T07:38:04.500 INFO:teuthology.orchestra.run.smithi151.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 1.0 MB/s | 884 kB 00:00 2024-09-16T07:38:04.500 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:04.501 INFO:teuthology.orchestra.run.smithi151.stdout:Total 982 kB/s | 964 kB 00:00 2024-09-16T07:38:04.513 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:38:04.538 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:38:04.538 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:38:04.618 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:38:04.619 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:38:04.821 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:38:04.977 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T07:38:05.058 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:38:05.777 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:38:05.777 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T07:38:06.055 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T07:38:06.055 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:06.056 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:38:06.056 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T07:38:06.056 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:06.056 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:38:06.333 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-volume 2024-09-16T07:38:06.925 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:05 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:38:07.061 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:38:07.062 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:07.062 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-09-16T07:38:07.062 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:07.062 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:38:07.062 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T07:38:07.062 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:07.062 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:38:07.063 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:07.063 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2024-09-16T07:38:07.063 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:07.063 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 285 k 2024-09-16T07:38:07.063 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 1.3 M 2024-09-16T07:38:07.063 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:38:07.354 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 982 kB/s | 285 kB 00:00 2024-09-16T07:38:07.354 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:07.355 INFO:teuthology.orchestra.run.smithi151.stdout:Total 976 kB/s | 285 kB 00:00 2024-09-16T07:38:07.355 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:38:07.364 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:38:07.364 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:38:07.394 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:38:07.394 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:38:07.614 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:38:07.689 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:38:07.706 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:38:07.706 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:38:07.706 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T07:38:07.706 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:08.698 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:38:08.698 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:08.698 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:38:08.698 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:08.698 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:08.698 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:38:09.037 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install librados-devel 2024-09-16T07:38:09.613 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:08 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:38:09.752 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:38:09.753 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repo Size 2024-09-16T07:38:09.753 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:09.753 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:38:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T07:38:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:09.753 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:38:09.753 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:09.753 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2024-09-16T07:38:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:09.754 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 125 k 2024-09-16T07:38:09.754 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 445 k 2024-09-16T07:38:09.754 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:38:09.975 INFO:teuthology.orchestra.run.smithi151.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 564 kB/s | 125 kB 00:00 2024-09-16T07:38:09.975 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:09.976 INFO:teuthology.orchestra.run.smithi151.stdout:Total 561 kB/s | 125 kB 00:00 2024-09-16T07:38:09.976 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:38:09.981 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:38:09.981 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:38:10.046 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:38:10.046 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:38:10.207 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:38:10.314 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:10.724 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:10.976 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:38:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:38:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:10.977 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:38:11.218 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install libcephfs2 2024-09-16T07:38:11.798 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:10 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:38:11.893 INFO:teuthology.orchestra.run.smithi151.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:11.937 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:38:11.938 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-09-16T07:38:11.939 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:38:12.021 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install libcephfs-devel 2024-09-16T07:38:12.588 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:11 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:38:12.720 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:38:12.720 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:12.721 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repo Size 2024-09-16T07:38:12.721 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:12.721 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:38:12.721 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T07:38:12.721 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:12.721 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:38:12.721 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:12.721 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2024-09-16T07:38:12.721 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:12.721 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 32 k 2024-09-16T07:38:12.721 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 142 k 2024-09-16T07:38:12.721 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:38:12.870 INFO:teuthology.orchestra.run.smithi151.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 214 kB/s | 32 kB 00:00 2024-09-16T07:38:12.870 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:12.870 INFO:teuthology.orchestra.run.smithi151.stdout:Total 212 kB/s | 32 kB 00:00 2024-09-16T07:38:12.871 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:38:12.874 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:38:12.874 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:38:12.901 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:38:12.901 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:38:12.991 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:38:13.100 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:13.502 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:13.734 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:13.735 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:13.735 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:38:13.735 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:38:13.735 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:13.735 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:38:13.916 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install librados2 2024-09-16T07:38:14.486 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:13 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:38:14.576 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:14.620 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:38:14.621 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-09-16T07:38:14.621 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:38:14.704 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install librbd1 2024-09-16T07:38:15.277 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:14 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:38:15.369 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:15.412 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:38:15.413 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-09-16T07:38:15.413 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:38:15.493 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install python3-rados 2024-09-16T07:38:16.069 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:15 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:38:16.161 INFO:teuthology.orchestra.run.smithi151.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:16.206 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:38:16.207 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-09-16T07:38:16.207 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:38:16.275 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install python3-rgw 2024-09-16T07:38:16.847 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:15 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:38:16.939 INFO:teuthology.orchestra.run.smithi151.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:16.982 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:38:16.983 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-09-16T07:38:16.983 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:38:17.054 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install python3-cephfs 2024-09-16T07:38:17.628 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:16 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:38:17.720 INFO:teuthology.orchestra.run.smithi151.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:17.763 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:38:17.764 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-09-16T07:38:17.764 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:38:17.835 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install python3-rbd 2024-09-16T07:38:18.411 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:17 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:38:18.502 INFO:teuthology.orchestra.run.smithi151.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:18.546 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:38:18.548 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-09-16T07:38:18.548 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:38:18.618 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install rbd-fuse 2024-09-16T07:38:19.190 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:18 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:38:19.325 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:38:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:19.326 INFO:teuthology.orchestra.run.smithi151.stdout: Package Architecture Version Repository Size 2024-09-16T07:38:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:38:19.326 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T07:38:19.326 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:38:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2024-09-16T07:38:19.326 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 91 k 2024-09-16T07:38:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 321 k 2024-09-16T07:38:19.327 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:38:19.531 INFO:teuthology.orchestra.run.smithi151.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 445 kB/s | 91 kB 00:00 2024-09-16T07:38:19.531 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:19.532 INFO:teuthology.orchestra.run.smithi151.stdout:Total 442 kB/s | 91 kB 00:00 2024-09-16T07:38:19.532 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:38:19.541 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:38:19.541 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:38:19.604 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:38:19.604 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:38:19.747 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:38:19.862 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:20.261 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:20.524 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:20.525 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:20.525 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:38:20.525 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:38:20.525 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:20.525 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:38:20.817 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install rbd-mirror 2024-09-16T07:38:21.401 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:20 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:38:21.537 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:38:21.538 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repo Size 2024-09-16T07:38:21.538 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:21.538 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:38:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:38:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:21.539 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:38:21.539 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:21.539 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2024-09-16T07:38:21.539 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:21.539 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 3.5 M 2024-09-16T07:38:21.539 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 30 M 2024-09-16T07:38:21.539 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:38:21.909 INFO:teuthology.orchestra.run.smithi151.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 9.5 MB/s | 3.5 MB 00:00 2024-09-16T07:38:21.910 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:21.910 INFO:teuthology.orchestra.run.smithi151.stdout:Total 9.4 MB/s | 3.5 MB 00:00 2024-09-16T07:38:21.910 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:38:21.922 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:38:21.922 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:38:22.005 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:38:22.006 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:38:22.605 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:38:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:22.702 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:22.702 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:38:22.702 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T07:38:22.702 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:38:22.702 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:38:22.703 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:23.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:23.976 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:23.976 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:38:23.976 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:38:23.976 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:23.977 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:38:24.241 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install rbd-nbd 2024-09-16T07:38:24.816 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:23 ago on Mon 16 Sep 2024 07:36:01 AM UTC. 2024-09-16T07:38:24.952 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-16T07:38:24.952 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:24.952 INFO:teuthology.orchestra.run.smithi151.stdout: Package Architecture Version Repository Size 2024-09-16T07:38:24.953 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:24.953 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-16T07:38:24.953 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T07:38:24.953 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:24.953 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-16T07:38:24.953 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-09-16T07:38:24.953 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2024-09-16T07:38:24.953 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:24.954 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 177 k 2024-09-16T07:38:24.954 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 685 k 2024-09-16T07:38:24.954 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-16T07:38:25.188 INFO:teuthology.orchestra.run.smithi151.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 757 kB/s | 177 kB 00:00 2024-09-16T07:38:25.188 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:25.188 INFO:teuthology.orchestra.run.smithi151.stdout:Total 752 kB/s | 177 kB 00:00 2024-09-16T07:38:25.188 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-16T07:38:25.198 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-16T07:38:25.198 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-16T07:38:25.268 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-16T07:38:25.268 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-16T07:38:25.433 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-16T07:38:25.529 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:26.048 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:26.302 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:26.302 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:26.302 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-16T07:38:26.302 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:38:26.302 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:26.302 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-16T07:38:26.581 DEBUG:teuthology.parallel:result is None 2024-09-16T07:38:26.581 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:38:26.726 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T07:38:26.747 INFO:teuthology.orchestra.run.smithi151.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T07:38:26.747 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T07:38:26.748 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T07:38:26.749 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T07:38:26.750 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:26.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T07:38:26.817 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T07:38:26.817 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:26.818 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T07:38:26.881 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T07:38:26.948 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T07:38:26.948 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:26.948 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T07:38:27.013 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T07:38:27.077 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T07:38:27.078 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:27.078 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T07:38:27.146 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T07:38:27.211 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T07:38:27.295 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T07:38:27.295 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2024-09-16T07:38:27.320 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T07:38:27.320 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T07:38:27.385 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T07:38:27.386 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T07:38:27.458 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T07:38:27.458 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T07:38:27.458 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906865', 'branch': 'wip-matanb-crimson-testing-59543', 'description': 'crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rbd_api_tests_old_format}', 'email': None, 'first_in_suite': False, 'job_id': '7906865', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 6651, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAJ9vxCelvAMb8R+u1YFKYjTwOAKTtZteoOtJYRXaKAIMvEIN0M/egP4u/OvDq26oy/gDFoyUWTtPJtdU3Ye20o='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rbd/crimson/test_crimson_librbd.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_07:15:55', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T07:38:27.459 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T07:38:27.506 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T07:38:27.572 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:27.572 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T07:38:27.628 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T07:38:27.628 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2024-09-16T07:38:27.683 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T07:38:27.683 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:38:27.684 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-16T07:38:27.684 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:38:27.684 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:38:27.684 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-16 07:38:22.975167548 +0000 2024-09-16T07:38:27.684 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-16 07:35:19.699552100 +0000 2024-09-16T07:38:27.684 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-16 07:35:19.699552100 +0000 2024-09-16T07:38:27.684 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-09-16 07:35:19.699552100 +0000 2024-09-16T07:38:27.684 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T07:38:27.747 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-16T07:38:27.747 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-16T07:38:27.747 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000181033 s, 2.8 MB/s 2024-09-16T07:38:27.748 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T07:38:27.804 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2024-09-16T07:38:27.860 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T07:38:27.860 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:38:27.860 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-16T07:38:27.860 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:38:27.860 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:38:27.860 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-16 07:38:22.975167548 +0000 2024-09-16T07:38:27.861 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-16 07:35:20.042548057 +0000 2024-09-16T07:38:27.861 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-16 07:35:20.042548057 +0000 2024-09-16T07:38:27.861 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-09-16 07:35:20.042548057 +0000 2024-09-16T07:38:27.861 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T07:38:27.923 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-16T07:38:27.923 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-16T07:38:27.923 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.0001672 s, 3.1 MB/s 2024-09-16T07:38:27.925 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T07:38:27.980 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2024-09-16T07:38:28.035 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T07:38:28.036 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:38:28.036 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-16T07:38:28.036 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:38:28.036 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:38:28.036 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-16 07:38:22.976167536 +0000 2024-09-16T07:38:28.036 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-16 07:35:20.382544049 +0000 2024-09-16T07:38:28.036 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-16 07:35:20.382544049 +0000 2024-09-16T07:38:28.036 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-09-16 07:35:20.382544049 +0000 2024-09-16T07:38:28.036 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T07:38:28.099 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-16T07:38:28.100 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-16T07:38:28.100 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000195126 s, 2.6 MB/s 2024-09-16T07:38:28.101 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T07:38:28.157 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2024-09-16T07:38:28.214 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T07:38:28.214 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:38:28.214 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-16T07:38:28.214 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:38:28.214 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:38:28.215 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-16 07:38:22.976167536 +0000 2024-09-16T07:38:28.215 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-16 07:35:20.715540123 +0000 2024-09-16T07:38:28.215 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-16 07:35:20.715540123 +0000 2024-09-16T07:38:28.215 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-09-16 07:35:20.715540123 +0000 2024-09-16T07:38:28.216 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T07:38:28.277 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-16T07:38:28.277 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-16T07:38:28.277 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000186245 s, 2.7 MB/s 2024-09-16T07:38:28.278 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T07:38:28.335 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T07:38:28.335 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-16T07:38:28.336 INFO:tasks.ceph:Generating config... 2024-09-16T07:38:28.338 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-16T07:38:28.338 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-16T07:38:28.338 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-16T07:38:28.338 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-16T07:38:28.338 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-16T07:38:28.338 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T07:38:28.338 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T07:38:28.338 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T07:38:28.338 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-16T07:38:28.338 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-16T07:38:28.338 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-16T07:38:28.338 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-16T07:38:28.338 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T07:38:28.339 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T07:38:28.339 INFO:tasks.ceph:[osd] osd objectstore = seastore 2024-09-16T07:38:28.339 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-16T07:38:28.339 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-16T07:38:28.339 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-16T07:38:28.339 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-16T07:38:28.339 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-16T07:38:28.339 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-16T07:38:28.339 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-16T07:38:28.339 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-16T07:38:28.339 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T07:38:28.339 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T07:38:28.340 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-16T07:38:28.340 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-1 2024-09-16T07:38:28.340 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 2-3 2024-09-16T07:38:28.340 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 4-5 2024-09-16T07:38:28.340 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T07:38:28.340 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T07:38:28.461 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T07:38:28.464 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T07:38:28.515 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:38:28.540 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.151')] 2024-09-16T07:38:28.540 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.151', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}} 2024-09-16T07:38:28.541 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:28.541 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T07:38:28.596 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.151 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:38:28.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:28.688+0000 7fe7a131ef00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:28.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:28.688+0000 7fe7a131ef00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:28.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:28.688+0000 7fe7a131ef00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:28.689 INFO:teuthology.orchestra.run.smithi151.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:38:28.689 INFO:teuthology.orchestra.run.smithi151.stdout:monmaptool: generated fsid 90090b2e-292a-455c-9d19-6e16a6c03bdd 2024-09-16T07:38:28.689 INFO:teuthology.orchestra.run.smithi151.stdout:setting min_mon_release = quincy 2024-09-16T07:38:28.689 INFO:teuthology.orchestra.run.smithi151.stdout:epoch 0 2024-09-16T07:38:28.689 INFO:teuthology.orchestra.run.smithi151.stdout:fsid 90090b2e-292a-455c-9d19-6e16a6c03bdd 2024-09-16T07:38:28.689 INFO:teuthology.orchestra.run.smithi151.stdout:last_changed 2024-09-16T07:38:28.689880+0000 2024-09-16T07:38:28.689 INFO:teuthology.orchestra.run.smithi151.stdout:created 2024-09-16T07:38:28.689880+0000 2024-09-16T07:38:28.689 INFO:teuthology.orchestra.run.smithi151.stdout:min_mon_release 17 (quincy) 2024-09-16T07:38:28.689 INFO:teuthology.orchestra.run.smithi151.stdout:election_strategy: 1 2024-09-16T07:38:28.689 INFO:teuthology.orchestra.run.smithi151.stdout:0: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.a 2024-09-16T07:38:28.689 INFO:teuthology.orchestra.run.smithi151.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-16T07:38:28.691 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T07:38:28.706 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 90090b2e-292a-455c-9d19-6e16a6c03bdd... 2024-09-16T07:38:28.708 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T07:38:28.789 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2024-09-16T07:38:28.789 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2024-09-16T07:38:28.789 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T07:38:28.789 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2024-09-16T07:38:28.790 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.790 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2024-09-16T07:38:28.790 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.790 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2024-09-16T07:38:28.790 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.790 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2024-09-16T07:38:28.790 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2024-09-16T07:38:28.790 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.790 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2024-09-16T07:38:28.790 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2024-09-16T07:38:28.790 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.791 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T07:38:28.791 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2024-09-16T07:38:28.791 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.791 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T07:38:28.791 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T07:38:28.791 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.791 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2024-09-16T07:38:28.791 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.791 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2024-09-16T07:38:28.791 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2024-09-16T07:38:28.791 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2024-09-16T07:38:28.791 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2024-09-16T07:38:28.791 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2024-09-16T07:38:28.791 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2024-09-16T07:38:28.792 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2024-09-16T07:38:28.792 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T07:38:28.792 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T07:38:28.792 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2024-09-16T07:38:28.792 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.792 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T07:38:28.792 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.792 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2024-09-16T07:38:28.792 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.792 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2024-09-16T07:38:28.792 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.792 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2024-09-16T07:38:28.792 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2024-09-16T07:38:28.792 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2024-09-16T07:38:28.793 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = 172.21.15.151 2024-09-16T07:38:28.793 INFO:teuthology.orchestra.run.smithi151.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T07:38:28.793 INFO:teuthology.orchestra.run.smithi151.stdout: ms client mode = crc 2024-09-16T07:38:28.793 INFO:teuthology.orchestra.run.smithi151.stdout: ms cluster mode = crc 2024-09-16T07:38:28.793 INFO:teuthology.orchestra.run.smithi151.stdout: ms mon client mode = crc 2024-09-16T07:38:28.793 INFO:teuthology.orchestra.run.smithi151.stdout: ms mon cluster mode = crc 2024-09-16T07:38:28.793 INFO:teuthology.orchestra.run.smithi151.stdout: ms mon service mode = crc 2024-09-16T07:38:28.793 INFO:teuthology.orchestra.run.smithi151.stdout: ms service mode = crc 2024-09-16T07:38:28.793 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = 90090b2e-292a-455c-9d19-6e16a6c03bdd 2024-09-16T07:38:28.793 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.794 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2024-09-16T07:38:28.794 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2024-09-16T07:38:28.794 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.794 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2024-09-16T07:38:28.794 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2024-09-16T07:38:28.794 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2024-09-16T07:38:28.794 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.794 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2024-09-16T07:38:28.794 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2024-09-16T07:38:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2024-09-16T07:38:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2024-09-16T07:38:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2024-09-16T07:38:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug trim objects = true 2024-09-16T07:38:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2024-09-16T07:38:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2024-09-16T07:38:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2024-09-16T07:38:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2024-09-16T07:38:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2024-09-16T07:38:28.796 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.796 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2024-09-16T07:38:28.796 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2024-09-16T07:38:28.796 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.796 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2024-09-16T07:38:28.796 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2024-09-16T07:38:28.796 INFO:teuthology.orchestra.run.smithi151.stdout: debug monc = 20 2024-09-16T07:38:28.796 INFO:teuthology.orchestra.run.smithi151.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T07:38:28.796 INFO:teuthology.orchestra.run.smithi151.stdout: crimson osd obc lru size = 10 2024-09-16T07:38:28.796 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-16T07:38:28.796 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2024-09-16T07:38:28.796 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = seastore 2024-09-16T07:38:28.796 INFO:teuthology.orchestra.run.smithi151.stdout: osd shutdown pgref assert = True 2024-09-16T07:38:28.796 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.797 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2024-09-16T07:38:28.797 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-16T07:38:28.797 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2024-09-16T07:38:28.797 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-09-16T07:38:28.797 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-09-16T07:38:28.797 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:38:28.797 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:38:28.797 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2024-09-16T07:38:28.797 INFO:teuthology.orchestra.run.smithi151.stdout: mgr stats period = 30 2024-09-16T07:38:28.797 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.797 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2024-09-16T07:38:28.798 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-16T07:38:28.798 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-09-16T07:38:28.798 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2024-09-16T07:38:28.798 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-09-16T07:38:28.798 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2024-09-16T07:38:28.798 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2024-09-16T07:38:28.798 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:38:28.798 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2024-09-16T07:38:28.798 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2024-09-16T07:38:28.798 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:38:28.798 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.798 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T07:38:28.798 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T07:38:28.798 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T07:38:28.799 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.799 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T07:38:28.799 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T07:38:28.799 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T07:38:28.799 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.799 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2024-09-16T07:38:28.799 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2024-09-16T07:38:28.799 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.799 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2024-09-16T07:38:28.799 INFO:teuthology.orchestra.run.smithi151.stdout: mon min osdmap epochs = 50 2024-09-16T07:38:28.799 INFO:teuthology.orchestra.run.smithi151.stdout: mon osdmap full prune interval = 2 2024-09-16T07:38:28.800 INFO:teuthology.orchestra.run.smithi151.stdout: mon osdmap full prune min = 15 2024-09-16T07:38:28.800 INFO:teuthology.orchestra.run.smithi151.stdout: mon osdmap full prune txsize = 2 2024-09-16T07:38:28.800 INFO:teuthology.orchestra.run.smithi151.stdout: paxos service trim min = 10 2024-09-16T07:38:28.800 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default crimson = True 2024-09-16T07:38:28.800 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:28.800 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2024-09-16T07:38:28.800 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2024-09-16T07:38:28.800 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2024-09-16T07:38:28.800 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2024-09-16T07:38:28.800 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T07:38:28.800 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T07:38:28.800 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2024-09-16T07:38:28.800 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.0] 2024-09-16T07:38:28.801 INFO:teuthology.orchestra.run.smithi151.stdout: crimson seastar cpu cores = 0-1 2024-09-16T07:38:28.801 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.1] 2024-09-16T07:38:28.801 INFO:teuthology.orchestra.run.smithi151.stdout: crimson seastar cpu cores = 2-3 2024-09-16T07:38:28.801 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.2] 2024-09-16T07:38:28.801 INFO:teuthology.orchestra.run.smithi151.stdout: crimson seastar cpu cores = 4-5 2024-09-16T07:38:28.802 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T07:38:28.802 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T07:38:28.908 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T07:38:28.908 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:28.908 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T07:38:28.924 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:28.924 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T07:38:28.980 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2024-09-16T07:38:28.980 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:28.980 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T07:38:28.980 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:38:29.054 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:29.055 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:38:29.110 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T07:38:29.111 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T07:38:29.111 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T07:38:29.210 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T07:38:29.213 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T07:38:29.214 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T07:38:29.214 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T07:38:29.264 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T07:38:29.277 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T07:38:29.277 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-16T07:38:29.277 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T07:38:29.302 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T07:38:29.302 INFO:tasks.ceph:role: osd.0 2024-09-16T07:38:29.302 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-16T07:38:29.303 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T07:38:29.374 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:38:29.375 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:38:29.375 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:38:29.375 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:38:29.375 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:38:29.375 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:38:29.375 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:38:29.375 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:38:29.375 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:38:29.375 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:38:29.892 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-16T07:38:29.894 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-16T07:38:29.894 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T07:38:30.027 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T07:38:30.061 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T07:38:30.127 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T07:38:30.127 INFO:tasks.ceph:role: osd.1 2024-09-16T07:38:30.128 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-16T07:38:30.128 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T07:38:30.200 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:38:30.201 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:38:30.201 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:38:30.201 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:38:30.201 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:38:30.201 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:38:30.201 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:38:30.201 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:38:30.201 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:38:30.201 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:38:30.660 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-16T07:38:30.663 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-16T07:38:30.663 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T07:38:30.753 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T07:38:30.782 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T07:38:30.847 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T07:38:30.847 INFO:tasks.ceph:role: osd.2 2024-09-16T07:38:30.847 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-16T07:38:30.848 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T07:38:30.919 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:38:30.919 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:38:30.920 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:38:30.920 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:38:30.920 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:38:30.920 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:38:30.920 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:38:30.920 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:38:30.920 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:38:30.920 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:38:31.411 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-16T07:38:31.412 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-16T07:38:31.413 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-16T07:38:31.561 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T07:38:31.592 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:38:31.890 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:38:31.891 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-09-16 07:38:31,892 seastar - Reactor backend: linux-aio 2024-09-16T07:38:31.906 INFO:teuthology.orchestra.run.smithi151.stderr:==27627==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:38:32.023 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-09-16 07:38:32,025 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:38:32.024 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-09-16 07:38:32,025 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-1 2024-09-16T07:38:32.024 INFO:teuthology.orchestra.run.smithi151.stderr:DEBUG 2024-09-16 07:38:32,026 [shard 0:main] seastar - reactor::drain 2024-09-16T07:38:32.559 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-09-16T07:38:32.559 INFO:teuthology.orchestra.run.smithi151.stderr:Suppressions used: 2024-09-16T07:38:32.559 INFO:teuthology.orchestra.run.smithi151.stderr: count bytes template 2024-09-16T07:38:32.559 INFO:teuthology.orchestra.run.smithi151.stderr: 1 8 MallocExtension::Register 2024-09-16T07:38:32.559 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-09-16T07:38:32.560 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-16T07:38:32.618 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:38:32.622 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-09-16 07:38:32,623 seastar - Reactor backend: linux-aio 2024-09-16T07:38:32.630 INFO:teuthology.orchestra.run.smithi151.stderr:==27625==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:38:32.917 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x8b56c 0x10d76c 0xdd31a 0x4ab1c 0xb85463a 0xba30910 0xba30bac 0xba30d73 0xba30fe7 0xba310f0 0xba3126c 0xba31a18 0xb9d8ccf 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T07:38:32.917 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:32.974 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133c3f 0xdd332 0x4b14c 0x9ed055b 0x9ed06ca 0x9ed0866 0x9ed0ab0 0x9ed11dc 0x9ed14b6 0x9ed185e 0x9ed4c38 0x9ed5894 0x9ed5b57 0x9ed67ce 0x9e21d32 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T07:38:32.974 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:33.139 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xdd323 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:33.139 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:33.196 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x8b56c 0x10d76c 0xdd31a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:33.196 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:33.215 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542c38 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T07:38:33.215 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:33.273 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542726 0x9e3397b 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T07:38:33.273 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:33.304 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xdd323 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:33.304 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:33.380 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133c3f 0xdd332 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T07:38:33.380 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:33.792 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542108 0x9e33959 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:33.792 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:33.849 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5541dea 0x5542d9c 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:33.850 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:34.828 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-09-16T07:38:34.828 INFO:teuthology.orchestra.run.smithi151.stderr:Suppressions used: 2024-09-16T07:38:34.828 INFO:teuthology.orchestra.run.smithi151.stderr: count bytes template 2024-09-16T07:38:34.828 INFO:teuthology.orchestra.run.smithi151.stderr: 1 8 MallocExtension::Register 2024-09-16T07:38:34.828 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-09-16T07:38:34.829 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-16T07:38:34.856 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T07:38:34.881 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:38:35.158 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:38:35.159 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-09-16 07:38:35,160 seastar - Reactor backend: linux-aio 2024-09-16T07:38:35.164 INFO:teuthology.orchestra.run.smithi151.stderr:==27672==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:38:35.281 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-09-16 07:38:35,283 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:38:35.281 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-09-16 07:38:35,283 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 2-3 2024-09-16T07:38:35.282 INFO:teuthology.orchestra.run.smithi151.stderr:DEBUG 2024-09-16 07:38:35,284 [shard 0:main] seastar - reactor::drain 2024-09-16T07:38:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-09-16T07:38:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:Suppressions used: 2024-09-16T07:38:35.794 INFO:teuthology.orchestra.run.smithi151.stderr: count bytes template 2024-09-16T07:38:35.794 INFO:teuthology.orchestra.run.smithi151.stderr: 1 8 MallocExtension::Register 2024-09-16T07:38:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-09-16T07:38:35.794 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-16T07:38:35.861 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:38:35.865 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-09-16 07:38:35,866 seastar - Reactor backend: linux-aio 2024-09-16T07:38:35.878 INFO:teuthology.orchestra.run.smithi151.stderr:==27670==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:38:36.162 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x42198 0x3ef7b 0xfd531 0xb85348d 0xb853540 0xb853656 0xb853736 0xb853df6 0xb853a6f 0xb853f61 0xb85436c 0xb85462b 0xba26389 0xba29be0 0xb9dc97b 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T07:38:36.162 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffafe908b2 0xffffffffb01a8239 0xffffffffb018e2a3 0xffffffffb0196a3b 0xffffffffb0196ebc 0xffffffffafe8c884 0xffffffffb0ad1d62 0xffffffffb0c00bb2 2024-09-16T07:38:36.219 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x162c08 0x422c4 0x3ef7b 0xfd531 0x975be44 0xb0e3259 0xb0e3909 0xb0cd902 0xb7ab1d6 0xb0f7f22 0xb0f5d46 0x9945feb 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T07:38:36.220 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:36.370 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10d778 0xdd31a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:36.370 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:36.428 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542120 0x9e33959 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:36.428 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:36.463 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542cde 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T07:38:36.463 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:36.520 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x357849f 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T07:38:36.520 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:36.535 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5541f20 0x9e33959 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:36.535 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:36.628 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9e33976 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T07:38:36.628 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:37.056 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x55426ab 0x9e3397b 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:37.057 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:37.114 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133cca 0xdd332 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:37.114 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:38.056 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-09-16T07:38:38.056 INFO:teuthology.orchestra.run.smithi151.stderr:Suppressions used: 2024-09-16T07:38:38.056 INFO:teuthology.orchestra.run.smithi151.stderr: count bytes template 2024-09-16T07:38:38.057 INFO:teuthology.orchestra.run.smithi151.stderr: 1 8 MallocExtension::Register 2024-09-16T07:38:38.057 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-09-16T07:38:38.057 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-16T07:38:38.081 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T07:38:38.106 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:38:38.388 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:38:38.389 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-09-16 07:38:38,391 seastar - Reactor backend: linux-aio 2024-09-16T07:38:38.394 INFO:teuthology.orchestra.run.smithi151.stderr:==27717==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:38:38.502 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab9d 0x5fe9be6 0x5fe9dc8 0x5fe9fdf 0x5fea2b5 0x60389b3 0x6038bb9 0x5fb8d06 0x5fb8ee0 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:38.502 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:38.512 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-09-16 07:38:38,513 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:38:38.512 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-09-16 07:38:38,513 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 4-5 2024-09-16T07:38:38.513 INFO:teuthology.orchestra.run.smithi151.stderr:DEBUG 2024-09-16 07:38:38,514 [shard 0:main] seastar - reactor::drain 2024-09-16T07:38:39.016 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-09-16T07:38:39.016 INFO:teuthology.orchestra.run.smithi151.stderr:Suppressions used: 2024-09-16T07:38:39.016 INFO:teuthology.orchestra.run.smithi151.stderr: count bytes template 2024-09-16T07:38:39.016 INFO:teuthology.orchestra.run.smithi151.stderr: 1 8 MallocExtension::Register 2024-09-16T07:38:39.016 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-09-16T07:38:39.017 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-16T07:38:39.077 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:38:39.081 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-09-16 07:38:39,082 seastar - Reactor backend: linux-aio 2024-09-16T07:38:39.100 INFO:teuthology.orchestra.run.smithi151.stderr:==27715==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:38:39.379 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xba21c51 0xba21dd8 0xba21f8e 0xba220db 0xb9ca77e 0xb9cee31 0x9843791 0x9af9974 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T07:38:39.379 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:39.437 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x61147af 0xba3480f 0xba349cc 0xba34b2c 0xba34cc8 0xba3505e 0xba35270 0xb9d20ef 0xb9d2514 0xb9d84d7 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9e12036 0x9e2237e 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T07:38:39.437 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:39.584 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x55422bf 0x9e3396e 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:39.584 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:39.642 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542108 0x9e33959 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:39.642 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:39.687 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542703 0x9e3397b 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T07:38:39.687 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:39.745 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542bf9 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T07:38:39.745 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:39.749 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9e33944 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:39.749 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:39.852 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x8b54f 0x10d76c 0xdd31a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T07:38:39.852 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:40.262 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10797f 0xdd2e1 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:40.262 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:40.320 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab6e 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:38:40.320 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-09-16T07:38:41.261 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-09-16T07:38:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:Suppressions used: 2024-09-16T07:38:41.262 INFO:teuthology.orchestra.run.smithi151.stderr: count bytes template 2024-09-16T07:38:41.262 INFO:teuthology.orchestra.run.smithi151.stderr: 1 8 MallocExtension::Register 2024-09-16T07:38:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-09-16T07:38:41.262 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-16T07:38:41.287 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T07:38:41.311 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T07:38:41.312 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:41.312 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T07:38:41.376 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:41.376 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T07:38:41.440 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:41.440 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T07:38:41.504 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:41.504 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T07:38:41.570 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:41.570 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T07:38:41.625 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T07:38:41.625 DEBUG:teuthology.orchestra.run.smithi151:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T07:38:41.688 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.x] 2024-09-16T07:38:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQB14OdmuU6rDBAA+uzXDpv2UDoHFDpaWMjxrw== 2024-09-16T07:38:41.688 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.0] 2024-09-16T07:38:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQB44OdmQos3LhAAENMqsM7SJ2zCseM6Ejjg0g== 2024-09-16T07:38:41.688 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.1] 2024-09-16T07:38:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQB84OdmkElIARAAJ8DmLEuV25CtwxJX+pFVBg== 2024-09-16T07:38:41.688 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.2] 2024-09-16T07:38:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQB/4OdmAA1oDhAAgJxlURhMnL68AxBjiePrLw== 2024-09-16T07:38:41.688 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2024-09-16T07:38:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQB14OdmQW7UDxAAZ/JaXWIqTo9cE0jud1pVlQ== 2024-09-16T07:38:41.689 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T07:38:41.790 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:38:41.851 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:38:41.912 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:38:41.973 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:38:42.037 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T07:38:42.038 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T07:38:42.062 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T07:38:42.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:42.177+0000 7f1360f43c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:42.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:42.177+0000 7f1360f43c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:42.191 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T07:38:42.216 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:38:42.272 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T07:38:42.273 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T07:38:42.273 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T07:38:42.314 INFO:tasks.ceph.mon.a:Started 2024-09-16T07:38:42.315 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T07:38:42.315 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T07:38:42.315 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T07:38:42.317 INFO:tasks.ceph.mgr.x:Started 2024-09-16T07:38:42.317 DEBUG:tasks.ceph:set 0 configs 2024-09-16T07:38:42.317 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T07:38:42.317 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T07:38:42.397 INFO:tasks.ceph.mon.a.smithi151.stderr:2024-09-16T07:38:42.396+0000 7f89b68ddc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:42.397 INFO:tasks.ceph.mon.a.smithi151.stderr:2024-09-16T07:38:42.396+0000 7f89b68ddc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:42.397 INFO:tasks.ceph.mon.a.smithi151.stderr:2024-09-16T07:38:42.397+0000 7f89b68ddc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:42.398 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-16T07:38:42.398+0000 7f77cea2f000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:42.421+0000 7fd4afd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:42.432+0000 7fd4afd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:42.502 INFO:teuthology.orchestra.run.smithi151.stderr:adjusted tunables profile to default 2024-09-16T07:38:42.513 INFO:tasks.ceph:check_enable_crimson: True 2024-09-16T07:38:42.513 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-16T07:38:42.513 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-16T07:38:42.604 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-16T07:38:42.603+0000 7f77cea2f000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:42.604 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-16T07:38:42.604+0000 7f77cea2f000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:42.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:42.613+0000 7f0f55d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:42.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:42.623+0000 7f0f55d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:42.726 INFO:tasks.ceph.mon.a.smithi151.stderr:2024-09-16T07:38:42.725+0000 7f89ad5f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-16T07:38:42.726 INFO:tasks.ceph.mon.a.smithi151.stderr:Please be aware that this feature is experimental, untested, 2024-09-16T07:38:42.726 INFO:tasks.ceph.mon.a.smithi151.stderr:unsupported, and may result in data corruption, data loss, 2024-09-16T07:38:42.726 INFO:tasks.ceph.mon.a.smithi151.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-16T07:38:42.726 INFO:tasks.ceph.mon.a.smithi151.stderr:feature with important data. 2024-09-16T07:38:42.726 INFO:tasks.ceph.mon.a.smithi151.stderr: 2024-09-16T07:38:43.514 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T07:38:43.514 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:43.514 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T07:38:43.539 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:43.539 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T07:38:43.605 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:38:43.605 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T07:38:43.671 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new b33fb345-52c6-41a7-a9b9-db9d9bcbd70a 0 2024-09-16T07:38:43.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:43.813+0000 7f7834f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:43.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:43.823+0000 7f7834f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:43.902 INFO:teuthology.orchestra.run.smithi151.stdout:0 2024-09-16T07:38:43.913 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 6d9c735b-5ce7-4289-9ed6-0ad7ab184314 1 2024-09-16T07:38:44.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:44.016+0000 7f3ddcd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:44.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:44.026+0000 7f3ddcd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:44.105 INFO:teuthology.orchestra.run.smithi151.stdout:1 2024-09-16T07:38:44.117 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 2d9fa793-4b3d-4391-a6ca-db1612b967fe 2 2024-09-16T07:38:44.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:44.220+0000 7fa54fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:44.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:44.229+0000 7fa54fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:44.326 INFO:teuthology.orchestra.run.smithi151.stdout:2 2024-09-16T07:38:44.340 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-16T07:38:44.371 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T07:38:44.371 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T07:38:44.414 INFO:tasks.ceph.osd.0:Started 2024-09-16T07:38:44.414 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-16T07:38:44.443 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T07:38:44.443 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-16T07:38:44.486 INFO:tasks.ceph.osd.1:Started 2024-09-16T07:38:44.486 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-16T07:38:44.516 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T07:38:44.516 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-16T07:38:44.559 INFO:tasks.ceph.osd.2:Started 2024-09-16T07:38:44.559 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:38:44.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:44.680+0000 7fb6902e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:44.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:44.689+0000 7fb6902e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:44.772 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:44.772 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":6,"fsid":"90090b2e-292a-455c-9d19-6e16a6c03bdd","created":"2024-09-16T07:38:42.421113+0000","modified":"2024-09-16T07:38:44.327285+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T07:38:44.327285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"b33fb345-52c6-41a7-a9b9-db9d9bcbd70a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6d9c735b-5ce7-4289-9ed6-0ad7ab184314","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2d9fa793-4b3d-4391-a6ca-db1612b967fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:38:44.789 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T07:38:44.789 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T07:38:45.091 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T07:38:45.196 INFO:teuthology.misc.health.smithi151.stderr:2024-09-16T07:38:45.191+0000 7f553f44f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:45.201 INFO:teuthology.misc.health.smithi151.stderr:2024-09-16T07:38:45.200+0000 7f553f44f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:45.270 INFO:teuthology.misc.health.smithi151.stdout: 2024-09-16T07:38:45.270 INFO:teuthology.misc.health.smithi151.stdout:{"epoch":6,"fsid":"90090b2e-292a-455c-9d19-6e16a6c03bdd","created":"2024-09-16T07:38:42.421113+0000","modified":"2024-09-16T07:38:44.327285+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T07:38:44.327285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"b33fb345-52c6-41a7-a9b9-db9d9bcbd70a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6d9c735b-5ce7-4289-9ed6-0ad7ab184314","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2d9fa793-4b3d-4391-a6ca-db1612b967fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:38:45.281 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-16T07:38:48.123 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-16T07:38:48.122+0000 7f776b7b4640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-16T07:38:51.583 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T07:38:51.691 INFO:teuthology.misc.health.smithi151.stderr:2024-09-16T07:38:51.687+0000 7fe7ef86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:51.695 INFO:teuthology.misc.health.smithi151.stderr:2024-09-16T07:38:51.695+0000 7fe7ef86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:51.881 INFO:teuthology.misc.health.smithi151.stdout: 2024-09-16T07:38:51.882 INFO:teuthology.misc.health.smithi151.stdout:{"epoch":10,"fsid":"90090b2e-292a-455c-9d19-6e16a6c03bdd","created":"2024-09-16T07:38:42.421113+0000","modified":"2024-09-16T07:38:51.189171+0000","last_up_change":"2024-09-16T07:38:50.179518+0000","last_in_change":"2024-09-16T07:38:44.327285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:38:51.142237+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b33fb345-52c6-41a7-a9b9-db9d9bcbd70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2678932617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6807","nonce":2678932617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2678932617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":2678932617}]},"public_addr":"172.21.15.151:6806/2678932617","cluster_addr":"172.21.15.151:6807/2678932617","heartbeat_back_addr":"172.21.15.151:6804/2678932617","heartbeat_front_addr":"172.21.15.151:6813/2678932617","state":["exists","up"]},{"osd":1,"uuid":"6d9c735b-5ce7-4289-9ed6-0ad7ab184314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2826126798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6803","nonce":2826126798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2826126798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":2826126798}]},"public_addr":"172.21.15.151:6802/2826126798","cluster_addr":"172.21.15.151:6803/2826126798","heartbeat_back_addr":"172.21.15.151:6808/2826126798","heartbeat_front_addr":"172.21.15.151:6805/2826126798","state":["exists","up"]},{"osd":2,"uuid":"2d9fa793-4b3d-4391-a6ca-db1612b967fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1756894788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1756894788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1756894788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1756894788}]},"public_addr":"172.21.15.151:6810/1756894788","cluster_addr":"172.21.15.151:6809/1756894788","heartbeat_back_addr":"172.21.15.151:6814/1756894788","heartbeat_front_addr":"172.21.15.151:6812/1756894788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:38:51.893 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-16T07:38:51.893 INFO:tasks.ceph:Creating RBD pool 2024-09-16T07:38:51.893 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T07:38:52.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:51.994+0000 7ff657e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:52.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:52.005+0000 7ff657e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:52.194 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'rbd' created 2024-09-16T07:38:52.214 DEBUG:teuthology.orchestra.run.smithi151:> rbd --cluster ceph pool init rbd 2024-09-16T07:38:52.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:52.306+0000 7f31e8fe5ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:52.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:52.307+0000 7f31e8fe5ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:52.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:52.313+0000 7f31e8fe5ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:55.277 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T07:38:55.278 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-16T07:38:55.278 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T07:38:55.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:55.384+0000 7fe0fcabd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:55.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:55.392+0000 7fe0fcabd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:55.578 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:55.591 INFO:teuthology.orchestra.run.smithi151.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-16T07:38:55.592 INFO:tasks.ceph_manager:config epoch is 1 2024-09-16T07:38:55.592 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T07:38:55.592 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T07:38:55.592 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T07:38:55.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:55.697+0000 7f57cf711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:55.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:55.705+0000 7f57cf711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:55.934 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:55.946 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3436888726},{"type":"v1","addr":"172.21.15.151:6801","nonce":3436888726}]},"active_addr":"172.21.15.151:6801/3436888726","active_change":"2024-09-16T07:38:47.107393+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":2958898852}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":415481330}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":225149441}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":28817618}]}]} 2024-09-16T07:38:55.948 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T07:38:55.948 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T07:38:55.948 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:38:56.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.052+0000 7f656d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.059+0000 7f656d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.241 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:56.242 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":14,"fsid":"90090b2e-292a-455c-9d19-6e16a6c03bdd","created":"2024-09-16T07:38:42.421113+0000","modified":"2024-09-16T07:38:55.212799+0000","last_up_change":"2024-09-16T07:38:50.179518+0000","last_in_change":"2024-09-16T07:38:44.327285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:38:51.142237+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:38:52.193669+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b33fb345-52c6-41a7-a9b9-db9d9bcbd70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2678932617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6807","nonce":2678932617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2678932617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":2678932617}]},"public_addr":"172.21.15.151:6806/2678932617","cluster_addr":"172.21.15.151:6807/2678932617","heartbeat_back_addr":"172.21.15.151:6804/2678932617","heartbeat_front_addr":"172.21.15.151:6813/2678932617","state":["exists","up"]},{"osd":1,"uuid":"6d9c735b-5ce7-4289-9ed6-0ad7ab184314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2826126798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6803","nonce":2826126798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2826126798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":2826126798}]},"public_addr":"172.21.15.151:6802/2826126798","cluster_addr":"172.21.15.151:6803/2826126798","heartbeat_back_addr":"172.21.15.151:6808/2826126798","heartbeat_front_addr":"172.21.15.151:6805/2826126798","state":["exists","up"]},{"osd":2,"uuid":"2d9fa793-4b3d-4391-a6ca-db1612b967fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1756894788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1756894788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1756894788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1756894788}]},"public_addr":"172.21.15.151:6810/1756894788","cluster_addr":"172.21.15.151:6809/1756894788","heartbeat_back_addr":"172.21.15.151:6814/1756894788","heartbeat_front_addr":"172.21.15.151:6812/1756894788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:38:56.255 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T07:38:56.255 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:38:56.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.360+0000 7f71b2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.367+0000 7f71b2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.553 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:56.554 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":14,"fsid":"90090b2e-292a-455c-9d19-6e16a6c03bdd","created":"2024-09-16T07:38:42.421113+0000","modified":"2024-09-16T07:38:55.212799+0000","last_up_change":"2024-09-16T07:38:50.179518+0000","last_in_change":"2024-09-16T07:38:44.327285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:38:51.142237+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:38:52.193669+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b33fb345-52c6-41a7-a9b9-db9d9bcbd70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2678932617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6807","nonce":2678932617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2678932617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":2678932617}]},"public_addr":"172.21.15.151:6806/2678932617","cluster_addr":"172.21.15.151:6807/2678932617","heartbeat_back_addr":"172.21.15.151:6804/2678932617","heartbeat_front_addr":"172.21.15.151:6813/2678932617","state":["exists","up"]},{"osd":1,"uuid":"6d9c735b-5ce7-4289-9ed6-0ad7ab184314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2826126798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6803","nonce":2826126798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2826126798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":2826126798}]},"public_addr":"172.21.15.151:6802/2826126798","cluster_addr":"172.21.15.151:6803/2826126798","heartbeat_back_addr":"172.21.15.151:6808/2826126798","heartbeat_front_addr":"172.21.15.151:6805/2826126798","state":["exists","up"]},{"osd":2,"uuid":"2d9fa793-4b3d-4391-a6ca-db1612b967fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1756894788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1756894788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1756894788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1756894788}]},"public_addr":"172.21.15.151:6810/1756894788","cluster_addr":"172.21.15.151:6809/1756894788","heartbeat_back_addr":"172.21.15.151:6814/1756894788","heartbeat_front_addr":"172.21.15.151:6812/1756894788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:38:56.567 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T07:38:56.568 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T07:38:56.568 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T07:38:56.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.679+0000 7f1296591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.679+0000 7fc01ac93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.680+0000 7efd6c4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.688+0000 7f1296591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.688+0000 7efd6c4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.688+0000 7fc01ac93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.719 INFO:teuthology.orchestra.run.smithi151.stdout:34359738375 2024-09-16T07:38:56.719 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T07:38:56.722 INFO:teuthology.orchestra.run.smithi151.stdout:38654705670 2024-09-16T07:38:56.722 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T07:38:56.723 INFO:teuthology.orchestra.run.smithi151.stdout:38654705670 2024-09-16T07:38:56.724 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T07:38:56.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.827+0000 7f055e151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.837+0000 7f055e151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.872+0000 7f399b6c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.881+0000 7f399b6c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.884+0000 7fee52ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:56.893+0000 7fee52ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:57.071 INFO:teuthology.orchestra.run.smithi151.stdout:34359738375 2024-09-16T07:38:57.077 INFO:teuthology.orchestra.run.smithi151.stdout:38654705670 2024-09-16T07:38:57.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.1 2024-09-16T07:38:57.087 DEBUG:teuthology.parallel:result is None 2024-09-16T07:38:57.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2024-09-16T07:38:57.092 DEBUG:teuthology.parallel:result is None 2024-09-16T07:38:57.105 INFO:teuthology.orchestra.run.smithi151.stdout:38654705670 2024-09-16T07:38:57.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-09-16T07:38:57.119 DEBUG:teuthology.parallel:result is None 2024-09-16T07:38:57.119 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:38:57.119 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:38:57.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:57.265+0000 7ff949591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:57.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:57.273+0000 7ff949591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:57.457 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:57.458 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2024-09-16T07:38:57.471 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-16T07:38:57.116998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":3348,"kb_used_data":3348,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156889836,"statfs":{"total":160658620416,"available":160655192064,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.407177"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.241910+0000","last_change":"2024-09-16T07:38:55.253872+0000","last_active":"2024-09-16T07:38:55.241910+0000","last_peered":"2024-09-16T07:38:55.241910+0000","last_clean":"2024-09-16T07:38:55.241910+0000","last_became_active":"2024-09-16T07:38:53.368303+0000","last_became_peered":"2024-09-16T07:38:53.368303+0000","last_unstale":"2024-09-16T07:38:55.241910+0000","last_undegraded":"2024-09-16T07:38:55.241910+0000","last_fullsized":"2024-09-16T07:38:55.241910+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.252744+0000","last_change":"2024-09-16T07:38:55.258470+0000","last_active":"2024-09-16T07:38:55.252744+0000","last_peered":"2024-09-16T07:38:55.252744+0000","last_clean":"2024-09-16T07:38:55.252744+0000","last_became_active":"2024-09-16T07:38:53.421597+0000","last_became_peered":"2024-09-16T07:38:53.421597+0000","last_unstale":"2024-09-16T07:38:55.252744+0000","last_undegraded":"2024-09-16T07:38:55.252744+0000","last_fullsized":"2024-09-16T07:38:55.252744+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.246859+0000","last_change":"2024-09-16T07:38:55.254755+0000","last_active":"2024-09-16T07:38:55.246859+0000","last_peered":"2024-09-16T07:38:55.246859+0000","last_clean":"2024-09-16T07:38:55.246859+0000","last_became_active":"2024-09-16T07:38:53.390728+0000","last_became_peered":"2024-09-16T07:38:53.390728+0000","last_unstale":"2024-09-16T07:38:55.246859+0000","last_undegraded":"2024-09-16T07:38:55.246859+0000","last_fullsized":"2024-09-16T07:38:55.246859+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.242720+0000","last_change":"2024-09-16T07:38:55.254425+0000","last_active":"2024-09-16T07:38:55.242720+0000","last_peered":"2024-09-16T07:38:55.242720+0000","last_clean":"2024-09-16T07:38:55.242720+0000","last_became_active":"2024-09-16T07:38:53.383421+0000","last_became_peered":"2024-09-16T07:38:53.383421+0000","last_unstale":"2024-09-16T07:38:55.242720+0000","last_undegraded":"2024-09-16T07:38:55.242720+0000","last_fullsized":"2024-09-16T07:38:55.242720+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.254427+0000","last_change":"2024-09-16T07:38:55.254427+0000","last_active":"2024-09-16T07:38:55.254427+0000","last_peered":"2024-09-16T07:38:55.254427+0000","last_clean":"2024-09-16T07:38:55.254427+0000","last_became_active":"2024-09-16T07:38:53.455109+0000","last_became_peered":"2024-09-16T07:38:53.455109+0000","last_unstale":"2024-09-16T07:38:55.254427+0000","last_undegraded":"2024-09-16T07:38:55.254427+0000","last_fullsized":"2024-09-16T07:38:55.254427+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.252766+0000","last_change":"2024-09-16T07:38:55.257328+0000","last_active":"2024-09-16T07:38:55.252766+0000","last_peered":"2024-09-16T07:38:55.252766+0000","last_clean":"2024-09-16T07:38:55.252766+0000","last_became_active":"2024-09-16T07:38:53.437900+0000","last_became_peered":"2024-09-16T07:38:53.437900+0000","last_unstale":"2024-09-16T07:38:55.252766+0000","last_undegraded":"2024-09-16T07:38:55.252766+0000","last_fullsized":"2024-09-16T07:38:55.252766+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.247285+0000","last_change":"2024-09-16T07:38:55.250937+0000","last_active":"2024-09-16T07:38:55.247285+0000","last_peered":"2024-09-16T07:38:55.247285+0000","last_clean":"2024-09-16T07:38:55.247285+0000","last_became_active":"2024-09-16T07:38:53.392759+0000","last_became_peered":"2024-09-16T07:38:53.392759+0000","last_unstale":"2024-09-16T07:38:55.247285+0000","last_undegraded":"2024-09-16T07:38:55.247285+0000","last_fullsized":"2024-09-16T07:38:55.247285+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.251989+0000","last_change":"2024-09-16T07:38:55.258108+0000","last_active":"2024-09-16T07:38:55.251989+0000","last_peered":"2024-09-16T07:38:55.251989+0000","last_clean":"2024-09-16T07:38:55.251989+0000","last_became_active":"2024-09-16T07:38:53.396984+0000","last_became_peered":"2024-09-16T07:38:53.396984+0000","last_unstale":"2024-09-16T07:38:55.251989+0000","last_undegraded":"2024-09-16T07:38:55.251989+0000","last_fullsized":"2024-09-16T07:38:55.251989+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":84,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.247520+0000","last_change":"2024-09-16T07:38:52.292504+0000","last_active":"2024-09-16T07:38:55.247520+0000","last_peered":"2024-09-16T07:38:55.247520+0000","last_clean":"2024-09-16T07:38:55.247520+0000","last_became_active":"2024-09-16T07:38:52.263855+0000","last_became_peered":"2024-09-16T07:38:52.263855+0000","last_unstale":"2024-09-16T07:38:55.247520+0000","last_undegraded":"2024-09-16T07:38:55.247520+0000","last_fullsized":"2024-09-16T07:38:55.247520+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:51.189171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:51.189171+0000","last_clean_scrub_stamp":"2024-09-16T07:38:51.189171+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160655192064,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":428,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297300,"statfs":{"total":53552873472,"available":53552435200,"internally_reserved":0,"allocated":438272,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1588,"kb_used_data":1588,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296140,"statfs":{"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1332,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296396,"statfs":{"total":53552873472,"available":53551509504,"internally_reserved":0,"allocated":1363968,"data_stored":1363968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551509504,"internally_reserved":0,"allocated":1363968,"data_stored":1363968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552435200,"internally_reserved":0,"allocated":438272,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:38:57.472 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:38:57.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:57.577+0000 7f4ea4311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:57.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:57.584+0000 7f4ea4311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:57.765 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:57.765 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2024-09-16T07:38:57.777 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-16T07:38:57.116998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":3348,"kb_used_data":3348,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156889836,"statfs":{"total":160658620416,"available":160655192064,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.407177"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.241910+0000","last_change":"2024-09-16T07:38:55.253872+0000","last_active":"2024-09-16T07:38:55.241910+0000","last_peered":"2024-09-16T07:38:55.241910+0000","last_clean":"2024-09-16T07:38:55.241910+0000","last_became_active":"2024-09-16T07:38:53.368303+0000","last_became_peered":"2024-09-16T07:38:53.368303+0000","last_unstale":"2024-09-16T07:38:55.241910+0000","last_undegraded":"2024-09-16T07:38:55.241910+0000","last_fullsized":"2024-09-16T07:38:55.241910+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.252744+0000","last_change":"2024-09-16T07:38:55.258470+0000","last_active":"2024-09-16T07:38:55.252744+0000","last_peered":"2024-09-16T07:38:55.252744+0000","last_clean":"2024-09-16T07:38:55.252744+0000","last_became_active":"2024-09-16T07:38:53.421597+0000","last_became_peered":"2024-09-16T07:38:53.421597+0000","last_unstale":"2024-09-16T07:38:55.252744+0000","last_undegraded":"2024-09-16T07:38:55.252744+0000","last_fullsized":"2024-09-16T07:38:55.252744+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.246859+0000","last_change":"2024-09-16T07:38:55.254755+0000","last_active":"2024-09-16T07:38:55.246859+0000","last_peered":"2024-09-16T07:38:55.246859+0000","last_clean":"2024-09-16T07:38:55.246859+0000","last_became_active":"2024-09-16T07:38:53.390728+0000","last_became_peered":"2024-09-16T07:38:53.390728+0000","last_unstale":"2024-09-16T07:38:55.246859+0000","last_undegraded":"2024-09-16T07:38:55.246859+0000","last_fullsized":"2024-09-16T07:38:55.246859+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.242720+0000","last_change":"2024-09-16T07:38:55.254425+0000","last_active":"2024-09-16T07:38:55.242720+0000","last_peered":"2024-09-16T07:38:55.242720+0000","last_clean":"2024-09-16T07:38:55.242720+0000","last_became_active":"2024-09-16T07:38:53.383421+0000","last_became_peered":"2024-09-16T07:38:53.383421+0000","last_unstale":"2024-09-16T07:38:55.242720+0000","last_undegraded":"2024-09-16T07:38:55.242720+0000","last_fullsized":"2024-09-16T07:38:55.242720+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.254427+0000","last_change":"2024-09-16T07:38:55.254427+0000","last_active":"2024-09-16T07:38:55.254427+0000","last_peered":"2024-09-16T07:38:55.254427+0000","last_clean":"2024-09-16T07:38:55.254427+0000","last_became_active":"2024-09-16T07:38:53.455109+0000","last_became_peered":"2024-09-16T07:38:53.455109+0000","last_unstale":"2024-09-16T07:38:55.254427+0000","last_undegraded":"2024-09-16T07:38:55.254427+0000","last_fullsized":"2024-09-16T07:38:55.254427+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.252766+0000","last_change":"2024-09-16T07:38:55.257328+0000","last_active":"2024-09-16T07:38:55.252766+0000","last_peered":"2024-09-16T07:38:55.252766+0000","last_clean":"2024-09-16T07:38:55.252766+0000","last_became_active":"2024-09-16T07:38:53.437900+0000","last_became_peered":"2024-09-16T07:38:53.437900+0000","last_unstale":"2024-09-16T07:38:55.252766+0000","last_undegraded":"2024-09-16T07:38:55.252766+0000","last_fullsized":"2024-09-16T07:38:55.252766+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.247285+0000","last_change":"2024-09-16T07:38:55.250937+0000","last_active":"2024-09-16T07:38:55.247285+0000","last_peered":"2024-09-16T07:38:55.247285+0000","last_clean":"2024-09-16T07:38:55.247285+0000","last_became_active":"2024-09-16T07:38:53.392759+0000","last_became_peered":"2024-09-16T07:38:53.392759+0000","last_unstale":"2024-09-16T07:38:55.247285+0000","last_undegraded":"2024-09-16T07:38:55.247285+0000","last_fullsized":"2024-09-16T07:38:55.247285+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.251989+0000","last_change":"2024-09-16T07:38:55.258108+0000","last_active":"2024-09-16T07:38:55.251989+0000","last_peered":"2024-09-16T07:38:55.251989+0000","last_clean":"2024-09-16T07:38:55.251989+0000","last_became_active":"2024-09-16T07:38:53.396984+0000","last_became_peered":"2024-09-16T07:38:53.396984+0000","last_unstale":"2024-09-16T07:38:55.251989+0000","last_undegraded":"2024-09-16T07:38:55.251989+0000","last_fullsized":"2024-09-16T07:38:55.251989+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":84,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:38:55.247520+0000","last_change":"2024-09-16T07:38:52.292504+0000","last_active":"2024-09-16T07:38:55.247520+0000","last_peered":"2024-09-16T07:38:55.247520+0000","last_clean":"2024-09-16T07:38:55.247520+0000","last_became_active":"2024-09-16T07:38:52.263855+0000","last_became_peered":"2024-09-16T07:38:52.263855+0000","last_unstale":"2024-09-16T07:38:55.247520+0000","last_undegraded":"2024-09-16T07:38:55.247520+0000","last_fullsized":"2024-09-16T07:38:55.247520+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:51.189171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:51.189171+0000","last_clean_scrub_stamp":"2024-09-16T07:38:51.189171+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160655192064,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":428,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297300,"statfs":{"total":53552873472,"available":53552435200,"internally_reserved":0,"allocated":438272,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1588,"kb_used_data":1588,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296140,"statfs":{"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1332,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296396,"statfs":{"total":53552873472,"available":53551509504,"internally_reserved":0,"allocated":1363968,"data_stored":1363968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551509504,"internally_reserved":0,"allocated":1363968,"data_stored":1363968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552435200,"internally_reserved":0,"allocated":438272,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:38:57.778 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:38:57.778 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T07:38:57.778 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T07:38:57.779 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T07:38:57.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:57.883+0000 7f3fe4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:57.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:38:57.889+0000 7f3fe4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:58.107 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:38:58.108 INFO:teuthology.orchestra.run.smithi151.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T07:38:58.121 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T07:38:58.121 INFO:teuthology.run_tasks:Running task workunit... 2024-09-16T07:38:58.135 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-16T07:38:58.135 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T07:38:58.135 DEBUG:teuthology.orchestra.run.smithi151:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T07:38:58.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:38:58.151 INFO:teuthology.orchestra.run.smithi151.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-16T07:38:58.151 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T07:38:58.207 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-16T07:38:58.207 DEBUG:teuthology.orchestra.run.smithi151:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-16T07:38:58.263 INFO:tasks.workunit:timeout=3h 2024-09-16T07:38:58.263 INFO:tasks.workunit:cleanup=True 2024-09-16T07:38:58.263 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-16T07:38:58.319 INFO:tasks.workunit.client.0.smithi151.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T07:39:48.534 INFO:tasks.workunit.client.0.smithi151.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-09-16T07:39:48.534 INFO:tasks.workunit.client.0.smithi151.stderr: 2024-09-16T07:39:48.535 INFO:tasks.workunit.client.0.smithi151.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T07:39:48.535 INFO:tasks.workunit.client.0.smithi151.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T07:39:48.535 INFO:tasks.workunit.client.0.smithi151.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T07:39:48.535 INFO:tasks.workunit.client.0.smithi151.stderr: 2024-09-16T07:39:48.535 INFO:tasks.workunit.client.0.smithi151.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T07:39:48.535 INFO:tasks.workunit.client.0.smithi151.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T07:39:48.535 INFO:tasks.workunit.client.0.smithi151.stderr: 2024-09-16T07:39:48.535 INFO:tasks.workunit.client.0.smithi151.stderr: git switch -c 2024-09-16T07:39:48.535 INFO:tasks.workunit.client.0.smithi151.stderr: 2024-09-16T07:39:48.535 INFO:tasks.workunit.client.0.smithi151.stderr:Or undo this operation with: 2024-09-16T07:39:48.536 INFO:tasks.workunit.client.0.smithi151.stderr: 2024-09-16T07:39:48.536 INFO:tasks.workunit.client.0.smithi151.stderr: git switch - 2024-09-16T07:39:48.536 INFO:tasks.workunit.client.0.smithi151.stderr: 2024-09-16T07:39:48.536 INFO:tasks.workunit.client.0.smithi151.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T07:39:48.536 INFO:tasks.workunit.client.0.smithi151.stderr: 2024-09-16T07:39:48.536 INFO:tasks.workunit.client.0.smithi151.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-09-16T07:39:48.538 DEBUG:teuthology.orchestra.run.smithi151:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T07:39:48.600 INFO:tasks.workunit.client.0.smithi151.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T07:39:48.602 INFO:tasks.workunit.client.0.smithi151.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T07:39:48.602 INFO:tasks.workunit.client.0.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T07:39:49.215 INFO:tasks.workunit.client.0.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T07:39:49.310 INFO:tasks.workunit.client.0.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T07:39:49.350 INFO:tasks.workunit.client.0.smithi151.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T07:39:49.352 INFO:tasks.workunit.client.0.smithi151.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T07:39:49.352 INFO:tasks.workunit.client.0.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T07:39:49.394 INFO:tasks.workunit.client.0.smithi151.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T07:39:49.398 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-16T07:39:49.398 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T07:39:49.456 INFO:tasks.workunit:Running workunits matching rbd/crimson/test_crimson_librbd.sh on client.0... 2024-09-16T07:39:49.457 INFO:tasks.workunit:Running workunit rbd/crimson/test_crimson_librbd.sh... 2024-09-16T07:39:49.458 DEBUG:teuthology.orchestra.run.smithi151:workunit test rbd/crimson/test_crimson_librbd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh 2024-09-16T07:39:49.564 INFO:tasks.workunit.client.0.smithi151.stdout:seed 29592 2024-09-16T07:39:49.565 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = TestLibRBD.* 2024-09-16T07:39:49.565 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 171 tests from 1 test suite. 2024-09-16T07:39:49.565 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:39:49.565 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 171 tests from TestLibRBD 2024-09-16T07:39:49.611 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.CreateAndStat 2024-09-16T07:39:51.447 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:39:53.615 INFO:tasks.workunit.client.0.smithi151.stdout:image has size 2097152 and order 22 2024-09-16T07:39:53.615 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.CreateAndStat (4005 ms) 2024-09-16T07:39:53.616 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.CreateWithSameDataPool 2024-09-16T07:39:53.616 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:780: Skipped 2024-09-16T07:39:53.616 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:39:53.616 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.CreateWithSameDataPool (0 ms) 2024-09-16T07:39:53.616 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.CreateAndStatPP 2024-09-16T07:39:53.616 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:39:53.722 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.CreateAndStatPP (106 ms) 2024-09-16T07:39:53.722 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.GetId 2024-09-16T07:39:53.722 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:39:53.826 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.GetId (105 ms) 2024-09-16T07:39:53.826 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.GetIdPP 2024-09-16T07:39:53.826 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:39:53.945 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.GetIdPP (118 ms) 2024-09-16T07:39:53.945 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefix 2024-09-16T07:39:53.945 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:39:54.056 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.GetBlockNamePrefix (112 ms) 2024-09-16T07:39:54.057 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefixPP 2024-09-16T07:39:54.057 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:39:54.166 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.GetBlockNamePrefixPP (109 ms) 2024-09-16T07:39:54.166 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestGetCreateTimestamp 2024-09-16T07:39:54.166 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:939: Skipped 2024-09-16T07:39:54.166 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:39:54.166 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestGetCreateTimestamp (0 ms) 2024-09-16T07:39:54.166 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.GetCreateTimestampPP 2024-09-16T07:39:54.166 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:962: Skipped 2024-09-16T07:39:54.166 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:39:54.166 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.GetCreateTimestampPP (0 ms) 2024-09-16T07:39:54.166 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.OpenAio 2024-09-16T07:39:54.167 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:39:54.272 INFO:tasks.workunit.client.0.smithi151.stdout:image has size 2097152 and order 22 2024-09-16T07:39:54.272 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.OpenAio (106 ms) 2024-09-16T07:39:54.272 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.OpenAioFail 2024-09-16T07:39:54.284 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.OpenAioFail (13 ms) 2024-09-16T07:39:54.284 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.OpenAioPP 2024-09-16T07:39:54.284 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:39:54.444 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.OpenAioPP (160 ms) 2024-09-16T07:39:54.445 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.OpenAioFailPP 2024-09-16T07:39:54.458 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.OpenAioFailPP (14 ms) 2024-09-16T07:39:54.459 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ResizeAndStat 2024-09-16T07:39:54.459 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:39:54.714 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.ResizeAndStat (255 ms) 2024-09-16T07:39:54.714 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ResizeAndStatPP 2024-09-16T07:39:54.714 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:39:54.922 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.ResizeAndStatPP (208 ms) 2024-09-16T07:39:54.922 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResize 2024-09-16T07:39:54.922 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:39:55.177 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.UpdateWatchAndResize (255 ms) 2024-09-16T07:39:55.177 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResizePP 2024-09-16T07:39:55.177 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:39:55.424 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.UpdateWatchAndResizePP (248 ms) 2024-09-16T07:39:55.425 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCreateLsDelete 2024-09-16T07:39:56.781 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:39:58.656 INFO:tasks.workunit.client.0.smithi151.stdout:image: image15 2024-09-16T07:39:58.656 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image15 2024-09-16T07:39:58.656 INFO:tasks.workunit.client.0.smithi151.stdout:found image15 2024-09-16T07:39:58.656 INFO:tasks.workunit.client.0.smithi151.stdout:erased image15 2024-09-16T07:39:58.656 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:39:58.936 INFO:tasks.workunit.client.0.smithi151.stdout:image: image15 2024-09-16T07:39:58.936 INFO:tasks.workunit.client.0.smithi151.stdout:image: image16 2024-09-16T07:39:58.936 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image15 2024-09-16T07:39:58.936 INFO:tasks.workunit.client.0.smithi151.stdout:found image15 2024-09-16T07:39:58.936 INFO:tasks.workunit.client.0.smithi151.stdout:erased image15 2024-09-16T07:39:58.936 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image16 2024-09-16T07:39:58.936 INFO:tasks.workunit.client.0.smithi151.stdout:found image16 2024-09-16T07:39:58.936 INFO:tasks.workunit.client.0.smithi151.stdout:erased image16 2024-09-16T07:39:58.936 INFO:tasks.workunit.client.0.smithi151.stdout:image: image16 2024-09-16T07:39:58.936 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image16 2024-09-16T07:39:58.936 INFO:tasks.workunit.client.0.smithi151.stdout:found image16 2024-09-16T07:39:58.937 INFO:tasks.workunit.client.0.smithi151.stdout:erased image16 2024-09-16T07:39:58.937 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCreateLsDelete (3511 ms) 2024-09-16T07:39:58.937 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCreateLsDeletePP 2024-09-16T07:40:00.538 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:40:02.698 INFO:tasks.workunit.client.0.smithi151.stdout:num images is: 1 2024-09-16T07:40:02.699 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 1 2024-09-16T07:40:02.699 INFO:tasks.workunit.client.0.smithi151.stdout:image: image17 2024-09-16T07:40:02.699 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image17 2024-09-16T07:40:02.699 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:40:02.763 INFO:tasks.workunit.client.0.smithi151.stdout:num images is: 2 2024-09-16T07:40:02.764 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 2 2024-09-16T07:40:02.764 INFO:tasks.workunit.client.0.smithi151.stdout:image: image17 2024-09-16T07:40:02.764 INFO:tasks.workunit.client.0.smithi151.stdout:image: image18 2024-09-16T07:40:02.764 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image17 2024-09-16T07:40:02.764 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image18 2024-09-16T07:40:02.894 INFO:tasks.workunit.client.0.smithi151.stdout:num images is: 1 2024-09-16T07:40:02.894 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 1 2024-09-16T07:40:02.894 INFO:tasks.workunit.client.0.smithi151.stdout:image: image18 2024-09-16T07:40:02.894 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image18 2024-09-16T07:40:02.894 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCreateLsDeletePP (3958 ms) 2024-09-16T07:40:02.894 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCopy 2024-09-16T07:40:04.564 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:40:13.758 INFO:tasks.workunit.client.0.smithi151.stdout:image: image19 2024-09-16T07:40:13.758 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image19 2024-09-16T07:40:13.758 INFO:tasks.workunit.client.0.smithi151.stdout:found image19 2024-09-16T07:40:13.758 INFO:tasks.workunit.client.0.smithi151.stdout:erased image19 2024-09-16T07:40:13.758 INFO:tasks.workunit.client.0.smithi151.stdout:image: image19 2024-09-16T07:40:13.758 INFO:tasks.workunit.client.0.smithi151.stdout:image: image20 2024-09-16T07:40:13.758 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image19 2024-09-16T07:40:13.759 INFO:tasks.workunit.client.0.smithi151.stdout:found image19 2024-09-16T07:40:13.759 INFO:tasks.workunit.client.0.smithi151.stdout:erased image19 2024-09-16T07:40:13.759 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image20 2024-09-16T07:40:13.759 INFO:tasks.workunit.client.0.smithi151.stdout:found image20 2024-09-16T07:40:13.759 INFO:tasks.workunit.client.0.smithi151.stdout:erased image20 2024-09-16T07:40:13.759 INFO:tasks.workunit.client.0.smithi151.stdout:0.00% done 2024-09-16T07:40:13.759 INFO:tasks.workunit.client.0.smithi151.stdout:100.00% done 2024-09-16T07:40:13.759 INFO:tasks.workunit.client.0.smithi151.stdout:image: image19 2024-09-16T07:40:13.759 INFO:tasks.workunit.client.0.smithi151.stdout:image: image20 2024-09-16T07:40:13.759 INFO:tasks.workunit.client.0.smithi151.stdout:image: image21 2024-09-16T07:40:13.759 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image19 2024-09-16T07:40:13.759 INFO:tasks.workunit.client.0.smithi151.stdout:found image19 2024-09-16T07:40:13.759 INFO:tasks.workunit.client.0.smithi151.stdout:erased image19 2024-09-16T07:40:13.759 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image20 2024-09-16T07:40:13.760 INFO:tasks.workunit.client.0.smithi151.stdout:found image20 2024-09-16T07:40:13.760 INFO:tasks.workunit.client.0.smithi151.stdout:erased image20 2024-09-16T07:40:13.760 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image21 2024-09-16T07:40:13.760 INFO:tasks.workunit.client.0.smithi151.stdout:found image21 2024-09-16T07:40:13.760 INFO:tasks.workunit.client.0.smithi151.stdout:erased image21 2024-09-16T07:40:13.760 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCopy (10864 ms) 2024-09-16T07:40:13.760 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCopyPP 2024-09-16T07:40:15.593 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:40:20.830 INFO:tasks.workunit.client.0.smithi151.stdout:num images is: 1 2024-09-16T07:40:20.830 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 1 2024-09-16T07:40:20.831 INFO:tasks.workunit.client.0.smithi151.stdout:image: image22 2024-09-16T07:40:20.831 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image22 2024-09-16T07:40:23.039 INFO:tasks.workunit.client.0.smithi151.stdout:num images is: 2 2024-09-16T07:40:23.039 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 2 2024-09-16T07:40:23.039 INFO:tasks.workunit.client.0.smithi151.stdout:image: image22 2024-09-16T07:40:23.039 INFO:tasks.workunit.client.0.smithi151.stdout:image: image23 2024-09-16T07:40:23.039 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image22 2024-09-16T07:40:23.039 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image23 2024-09-16T07:40:24.004 INFO:tasks.workunit.client.0.smithi151.stdout:0.00% done 2024-09-16T07:40:24.004 INFO:tasks.workunit.client.0.smithi151.stdout:100.00% done 2024-09-16T07:40:24.005 INFO:tasks.workunit.client.0.smithi151.stdout:num images is: 3 2024-09-16T07:40:24.005 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 3 2024-09-16T07:40:24.005 INFO:tasks.workunit.client.0.smithi151.stdout:image: image22 2024-09-16T07:40:24.005 INFO:tasks.workunit.client.0.smithi151.stdout:image: image23 2024-09-16T07:40:24.005 INFO:tasks.workunit.client.0.smithi151.stdout:image: image24 2024-09-16T07:40:24.005 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image22 2024-09-16T07:40:24.006 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image23 2024-09-16T07:40:24.006 INFO:tasks.workunit.client.0.smithi151.stdout:expected = image24 2024-09-16T07:40:24.689 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCopyPP (10931 ms) 2024-09-16T07:40:24.689 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestDeepCopy 2024-09-16T07:40:24.690 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:1578: Skipped 2024-09-16T07:40:24.690 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:40:24.690 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopy (0 ms) 2024-09-16T07:40:24.690 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestDeepCopyPP 2024-09-16T07:40:24.690 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:1745: Skipped 2024-09-16T07:40:24.690 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:40:24.690 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopyPP (0 ms) 2024-09-16T07:40:24.690 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnap 2024-09-16T07:40:24.690 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:40:28.847 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 1 2024-09-16T07:40:28.847 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 1 2024-09-16T07:40:28.847 INFO:tasks.workunit.client.0.smithi151.stdout:snap: snap1 2024-09-16T07:40:28.847 INFO:tasks.workunit.client.0.smithi151.stdout:found snap1 with size 2097152 2024-09-16T07:40:28.847 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 2 2024-09-16T07:40:28.847 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 2 2024-09-16T07:40:28.847 INFO:tasks.workunit.client.0.smithi151.stdout:snap: snap1 2024-09-16T07:40:28.848 INFO:tasks.workunit.client.0.smithi151.stdout:snap: snap2 2024-09-16T07:40:28.848 INFO:tasks.workunit.client.0.smithi151.stdout:found snap1 with size 2097152 2024-09-16T07:40:28.848 INFO:tasks.workunit.client.0.smithi151.stdout:found snap2 with size 4194304 2024-09-16T07:40:28.848 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 1 2024-09-16T07:40:28.848 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 1 2024-09-16T07:40:28.848 INFO:tasks.workunit.client.0.smithi151.stdout:snap: snap2 2024-09-16T07:40:28.848 INFO:tasks.workunit.client.0.smithi151.stdout:found snap2 with size 4194304 2024-09-16T07:40:28.848 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 0 2024-09-16T07:40:28.848 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 0 2024-09-16T07:40:28.848 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnap (4158 ms) 2024-09-16T07:40:28.848 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestGetSnapShotTimeStamp 2024-09-16T07:40:28.848 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:1890: Skipped 2024-09-16T07:40:28.849 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:40:28.849 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestGetSnapShotTimeStamp (0 ms) 2024-09-16T07:40:28.849 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnapPP 2024-09-16T07:40:28.849 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:40:29.800 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 1 2024-09-16T07:40:29.800 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 1 2024-09-16T07:40:29.800 INFO:tasks.workunit.client.0.smithi151.stdout:snap: snap1 2024-09-16T07:40:29.800 INFO:tasks.workunit.client.0.smithi151.stdout:found snap1 with size 2097152 2024-09-16T07:40:30.805 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 2 2024-09-16T07:40:30.805 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 2 2024-09-16T07:40:30.805 INFO:tasks.workunit.client.0.smithi151.stdout:snap: snap1 2024-09-16T07:40:30.805 INFO:tasks.workunit.client.0.smithi151.stdout:snap: snap2 2024-09-16T07:40:30.805 INFO:tasks.workunit.client.0.smithi151.stdout:found snap1 with size 2097152 2024-09-16T07:40:30.805 INFO:tasks.workunit.client.0.smithi151.stdout:found snap2 with size 4194304 2024-09-16T07:40:31.857 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 1 2024-09-16T07:40:31.857 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 1 2024-09-16T07:40:31.857 INFO:tasks.workunit.client.0.smithi151.stdout:snap: snap2 2024-09-16T07:40:31.857 INFO:tasks.workunit.client.0.smithi151.stdout:found snap2 with size 4194304 2024-09-16T07:40:32.838 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 0 2024-09-16T07:40:32.838 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 0 2024-09-16T07:40:32.857 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnapPP (4011 ms) 2024-09-16T07:40:32.857 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestGetNameIdSnapPP 2024-09-16T07:40:32.857 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:40:38.842 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 0 2024-09-16T07:40:38.842 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 0 2024-09-16T07:40:38.857 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestGetNameIdSnapPP (6000 ms) 2024-09-16T07:40:38.857 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCreateLsRenameSnapPP 2024-09-16T07:40:38.857 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:40:39.893 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 1 2024-09-16T07:40:39.894 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 1 2024-09-16T07:40:39.894 INFO:tasks.workunit.client.0.smithi151.stdout:snap: snap1 2024-09-16T07:40:39.894 INFO:tasks.workunit.client.0.smithi151.stdout:found snap1 with size 2097152 2024-09-16T07:40:40.862 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 2 2024-09-16T07:40:40.862 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 2 2024-09-16T07:40:40.862 INFO:tasks.workunit.client.0.smithi151.stdout:snap: snap1 2024-09-16T07:40:40.863 INFO:tasks.workunit.client.0.smithi151.stdout:snap: snap2 2024-09-16T07:40:40.863 INFO:tasks.workunit.client.0.smithi151.stdout:found snap1 with size 2097152 2024-09-16T07:40:40.863 INFO:tasks.workunit.client.0.smithi151.stdout:found snap2 with size 4194304 2024-09-16T07:40:40.918 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 2 2024-09-16T07:40:40.918 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 2 2024-09-16T07:40:40.918 INFO:tasks.workunit.client.0.smithi151.stdout:snap: snap1-rename 2024-09-16T07:40:40.918 INFO:tasks.workunit.client.0.smithi151.stdout:snap: snap2 2024-09-16T07:40:40.918 INFO:tasks.workunit.client.0.smithi151.stdout:found snap1-rename with size 2097152 2024-09-16T07:40:40.919 INFO:tasks.workunit.client.0.smithi151.stdout:found snap2 with size 4194304 2024-09-16T07:40:41.915 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 1 2024-09-16T07:40:41.916 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 1 2024-09-16T07:40:41.916 INFO:tasks.workunit.client.0.smithi151.stdout:snap: snap2-rename 2024-09-16T07:40:41.916 INFO:tasks.workunit.client.0.smithi151.stdout:found snap2-rename with size 4194304 2024-09-16T07:40:42.881 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 0 2024-09-16T07:40:42.881 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 0 2024-09-16T07:40:42.896 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCreateLsRenameSnapPP (4039 ms) 2024-09-16T07:40:42.896 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ConcurrentCreatesUnvalidatedPool 2024-09-16T07:40:44.695 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:40:44.695 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:40:44.695 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:40:44.696 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:40:47.592 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.ConcurrentCreatesUnvalidatedPool (4695 ms) 2024-09-16T07:40:47.592 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.RemoveFullTry 2024-09-16T07:40:51.955 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:41:23.258 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.RemoveFullTry (35665 ms) 2024-09-16T07:41:23.258 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.RemoveFullTryDataPool 2024-09-16T07:41:23.259 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2227: Skipped 2024-09-16T07:41:23.259 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:41:23.259 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryDataPool (0 ms) 2024-09-16T07:41:23.259 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespace 2024-09-16T07:41:23.259 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2247: Skipped 2024-09-16T07:41:23.259 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:41:23.259 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespace (0 ms) 2024-09-16T07:41:23.259 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespaceDataPool 2024-09-16T07:41:23.259 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2269: Skipped 2024-09-16T07:41:23.259 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:41:23.260 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespaceDataPool (0 ms) 2024-09-16T07:41:23.260 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestIO 2024-09-16T07:41:23.260 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:41:55.375 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:41:55.522 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:41:55.522 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:41:55.522 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:41:55.523 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:41:55.523 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.523 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:41:55.523 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.523 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.523 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:41:55.523 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.523 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:41:55.524 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.524 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.524 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:41:55.524 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.524 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:41:55.524 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.524 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.524 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:41:55.524 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.528 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:41:55.528 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.528 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.528 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:41:55.528 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.528 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:41:55.529 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.529 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.529 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:41:55.529 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:41:55.529 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:41:55.529 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:41:55.529 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:41:55.529 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:41:55.529 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:41:55.529 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:41:55.529 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:41:55.530 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:41:55.530 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:41:55.530 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.530 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:41:55.530 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.530 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.530 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:41:55.530 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.530 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:41:55.530 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.530 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.530 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:41:55.530 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.530 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:41:55.531 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.531 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.531 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:41:55.531 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.531 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:41:55.531 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.531 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.531 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:41:55.531 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.531 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:41:55.531 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.531 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.531 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:41:55.531 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:41:55.532 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:41:55.532 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:41:55.532 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:41:55.532 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:41:55.532 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.532 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:41:55.532 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:41:55.532 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:41:55.532 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.532 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:41:55.532 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:41:55.532 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:41:55.532 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.533 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:41:55.533 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:41:55.533 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:41:55.533 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.533 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:41:55.533 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:41:55.533 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:41:55.533 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.533 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:41:55.533 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:41:55.533 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:41:55.533 INFO:tasks.workunit.client.0.smithi151.stdout:discard: 512~512 = 512 2024-09-16T07:41:55.533 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.533 INFO:tasks.workunit.client.0.smithi151.stdout:aio discard: 1536~512 = 0 2024-09-16T07:41:55.534 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:41:55.534 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:41:55.534 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:41:55.534 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:41:55.534 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:41:55.534 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 0 2024-09-16T07:41:55.534 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.534 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.534 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 0 2024-09-16T07:41:55.534 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.534 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.534 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 16384 2024-09-16T07:41:55.534 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.534 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.535 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 16384 2024-09-16T07:41:55.535 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.535 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.535 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:41:55.535 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:41:55.535 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 49152 2024-09-16T07:41:55.535 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.535 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.535 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 49152 2024-09-16T07:41:55.535 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.535 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.535 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 65536 2024-09-16T07:41:55.535 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.535 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.536 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 65536 2024-09-16T07:41:55.536 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.536 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.536 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:41:55.536 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:41:55.536 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 98304 2024-09-16T07:41:55.536 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.536 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.536 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 98304 2024-09-16T07:41:55.536 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.536 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.536 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 114688 2024-09-16T07:41:55.536 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.536 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.537 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 114688 2024-09-16T07:41:55.537 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.537 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.537 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:41:55.537 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:41:55.537 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 147456 2024-09-16T07:41:55.537 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.537 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.537 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 147456 2024-09-16T07:41:55.537 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.537 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.538 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 163840 2024-09-16T07:41:55.538 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.538 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.538 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 163840 2024-09-16T07:41:55.538 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.538 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.538 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:41:55.538 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:41:55.538 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 196608 2024-09-16T07:41:55.538 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.538 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.538 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 196608 2024-09-16T07:41:55.538 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.538 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.539 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 212992 2024-09-16T07:41:55.539 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.539 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.539 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 212992 2024-09-16T07:41:55.539 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.539 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.539 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:41:55.539 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:41:55.539 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.539 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:41:55.539 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.539 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.539 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:41:55.539 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.540 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.540 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.540 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:41:55.540 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.540 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.540 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:41:55.540 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.540 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.540 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.540 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:41:55.540 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.540 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.540 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:41:55.541 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.541 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.541 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.541 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:41:55.541 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.541 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.541 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:41:55.541 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.541 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.541 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.541 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:41:55.541 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:41:55.541 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.542 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:41:55.542 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:41:55.542 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.542 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:41:55.542 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.542 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.542 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:41:55.542 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.542 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.542 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:41:55.542 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:41:55.542 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:41:55.542 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:41:55.542 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:41:55.543 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:41:55.543 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:41:55.543 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.792 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.792 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:42:22.793 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:42:22.793 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:42:22.793 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:42:22.793 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:42:22.793 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.793 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.793 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:42:22.793 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:42:22.793 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:42:22.793 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:42:22.793 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:42:22.793 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.793 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.794 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:42:22.794 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.794 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.794 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:42:22.794 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.794 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.794 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:42:22.794 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:42:22.794 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:42:22.794 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:42:22.794 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:42:22.794 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.794 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.794 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:42:22.795 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:42:22.795 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:42:22.795 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:42:22.795 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:42:22.795 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.795 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.795 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:42:22.795 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:42:22.795 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:42:22.795 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:42:22.795 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:42:22.795 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.795 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.796 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:42:22.796 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:42:22.796 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:42:22.796 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:42:22.796 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:42:22.796 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.796 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.796 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:42:22.796 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.796 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.796 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:42:22.796 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.796 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.796 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:42:22.797 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:42:22.797 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:42:22.797 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:42:22.797 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:42:22.797 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.797 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.797 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:42:22.797 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:42:22.797 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:42:22.797 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:42:22.797 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:42:22.797 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.798 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.798 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:42:22.798 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:42:22.798 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:42:22.798 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:42:22.798 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:42:22.798 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.798 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.798 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:42:22.798 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:42:22.798 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:42:22.798 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:42:22.798 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:42:22.798 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.799 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.799 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:42:22.799 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.799 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.799 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:42:22.799 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.799 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.799 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:42:22.799 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:42:22.799 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:42:22.799 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:42:22.800 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:42:22.800 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.800 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.800 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:42:22.800 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:42:22.800 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:42:22.800 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:42:22.800 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:42:22.800 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.800 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.800 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:42:22.800 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:42:22.800 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:42:22.801 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:42:22.801 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:42:22.801 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.801 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.801 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:42:22.801 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:42:22.801 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:42:22.801 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:42:22.801 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:42:22.801 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.801 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.801 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:42:22.801 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:42:22.802 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:42:22.802 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:42:22.802 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:42:22.802 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:42:22.802 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:42:22.802 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:42:22.802 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestIO (59535 ms) 2024-09-16T07:42:22.802 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS1 2024-09-16T07:42:22.802 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:43:03.138 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:43:03.139 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:43:03.139 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:43:03.139 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:43:03.139 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:43:03.139 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.139 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:43:03.139 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.140 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.140 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:43:03.140 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.140 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:43:03.140 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.140 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.140 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:43:03.140 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.140 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:43:03.140 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.140 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.140 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:43:03.140 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.141 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:43:03.141 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.141 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.141 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:43:03.141 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.141 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:43:03.141 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.141 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.141 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:43:03.141 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:43:03.141 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:43:03.141 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:43:03.142 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:43:03.142 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:43:03.142 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:43:03.142 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:43:03.142 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:43:03.142 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:43:03.142 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:43:03.142 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.142 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:43:03.142 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.142 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.142 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:43:03.142 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.142 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:43:03.143 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.143 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.143 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:43:03.143 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.143 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:43:03.143 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.143 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.143 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:43:03.143 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.143 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:43:03.143 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.143 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.143 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:43:03.144 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.144 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:43:03.144 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.144 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.144 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:43:03.144 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:43:03.144 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:43:03.144 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:43:03.144 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:43:03.144 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:43:03.144 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.144 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:43:03.144 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:43:03.145 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:43:03.145 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.145 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:43:03.145 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:43:03.145 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:43:03.145 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.145 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:43:03.145 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:43:03.145 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:43:03.145 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.145 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:43:03.145 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:43:03.145 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:43:03.145 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.146 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:43:03.146 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:43:03.146 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:43:03.146 INFO:tasks.workunit.client.0.smithi151.stdout:discard: 512~512 = 512 2024-09-16T07:43:03.146 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.146 INFO:tasks.workunit.client.0.smithi151.stdout:aio discard: 1536~512 = 0 2024-09-16T07:43:03.146 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:43:03.146 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:43:03.146 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:43:03.146 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:43:03.146 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:43:03.146 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 0 2024-09-16T07:43:03.146 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.147 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.147 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 0 2024-09-16T07:43:03.147 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.147 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.147 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 16384 2024-09-16T07:43:03.147 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.147 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.147 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 16384 2024-09-16T07:43:03.147 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.147 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.147 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:03.147 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:03.147 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 49152 2024-09-16T07:43:03.147 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.148 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.148 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 49152 2024-09-16T07:43:03.148 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.148 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.148 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 65536 2024-09-16T07:43:03.148 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.148 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.148 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 65536 2024-09-16T07:43:03.148 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.148 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.148 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:03.148 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:03.148 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 98304 2024-09-16T07:43:03.149 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.149 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.149 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 98304 2024-09-16T07:43:03.149 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.149 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.149 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 114688 2024-09-16T07:43:03.149 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.149 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.149 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 114688 2024-09-16T07:43:03.149 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.149 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.149 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:03.149 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:03.149 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 147456 2024-09-16T07:43:03.150 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.150 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.150 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 147456 2024-09-16T07:43:03.150 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.150 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.150 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 163840 2024-09-16T07:43:03.150 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.150 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.150 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 163840 2024-09-16T07:43:03.150 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.150 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.150 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:03.150 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:03.150 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 196608 2024-09-16T07:43:03.151 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.151 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.151 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 196608 2024-09-16T07:43:03.151 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.151 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.151 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 212992 2024-09-16T07:43:03.151 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.151 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.151 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 212992 2024-09-16T07:43:03.151 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.151 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.151 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:03.151 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:03.151 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.151 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:03.152 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.152 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.152 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:03.152 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.152 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.152 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.152 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:03.152 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.152 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.152 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:03.152 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.152 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.153 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.153 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:03.153 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.153 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.153 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:03.153 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.153 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.153 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.153 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:03.153 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.153 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.153 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:03.153 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.154 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.154 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.154 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:03.154 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:03.154 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.154 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:03.154 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:03.154 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.154 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:03.154 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.154 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.154 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:03.154 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.154 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.155 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:03.155 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:03.155 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:03.155 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:03.155 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:03.155 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:03.155 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:03.155 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.815 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.815 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:39.816 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:39.816 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:39.816 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:39.816 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:39.816 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.816 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.816 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:39.816 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:39.816 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:39.816 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:39.816 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:39.816 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.816 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.817 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:39.817 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.817 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.817 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:39.817 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.817 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.817 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:39.817 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:39.817 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:39.817 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:39.817 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:39.817 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.817 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.817 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:39.818 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:39.818 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:39.818 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:39.818 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:39.818 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.818 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.818 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:39.818 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:39.818 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:39.818 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:39.818 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:39.818 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.818 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.819 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:39.819 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:39.819 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:39.819 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:39.819 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:39.819 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.819 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.819 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:39.819 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.819 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.819 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:39.819 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.819 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.820 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:39.820 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:39.820 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:39.820 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:39.820 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:39.820 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.820 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.820 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:39.820 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:39.820 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:39.820 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:39.820 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:39.820 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.821 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.821 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:39.821 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:39.821 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:39.821 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:39.821 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:39.821 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.821 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.821 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:39.822 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:39.822 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:39.822 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:39.822 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:39.822 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.822 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.822 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:39.822 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.822 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.822 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:39.822 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.822 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.823 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:39.823 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:39.823 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:39.823 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:39.823 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:39.823 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.823 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.823 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:39.823 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:39.823 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:39.824 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:39.824 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:39.824 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.824 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.824 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:39.824 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:39.824 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:39.824 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:39.824 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:39.824 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.824 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.824 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:43:39.825 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:43:39.825 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:43:39.825 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:43:39.825 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:43:39.825 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.825 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.825 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:39.825 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:43:39.825 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:43:39.825 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:43:39.825 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:43:39.825 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:43:39.826 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:43:39.826 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:43:39.826 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 4 2024-09-16T07:43:39.826 INFO:tasks.workunit.client.0.smithi151.stdout:read: 4 2024-09-16T07:43:39.826 INFO:tasks.workunit.client.0.smithi151.stdout:read: 4 2024-09-16T07:43:39.826 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS1 (77023 ms) 2024-09-16T07:43:39.826 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS2 2024-09-16T07:43:39.826 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:44:22.225 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:44:22.226 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:44:22.226 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:44:22.226 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:44:22.226 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:44:22.226 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.226 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:44:22.226 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.226 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.226 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:44:22.226 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.226 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:44:22.226 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.227 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.227 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:44:22.227 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.227 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:44:22.227 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.227 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.227 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:44:22.227 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.227 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:44:22.227 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.227 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.227 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:44:22.227 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.228 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:44:22.228 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.228 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.228 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:44:22.228 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:44:22.228 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:44:22.228 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:44:22.228 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:44:22.228 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:44:22.228 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:44:22.228 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:44:22.228 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:44:22.228 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:44:22.229 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:44:22.229 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.229 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:44:22.229 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.229 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.229 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:44:22.229 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.229 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:44:22.229 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.229 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.229 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:44:22.229 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.229 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:44:22.230 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.230 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.230 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:44:22.230 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.230 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:44:22.230 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.230 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.230 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:44:22.230 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.230 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:44:22.230 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.230 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.230 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:44:22.230 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:44:22.231 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:44:22.231 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:44:22.231 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:44:22.231 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:44:22.231 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.231 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:44:22.231 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:44:22.231 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:44:22.231 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.231 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:44:22.231 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:44:22.231 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:44:22.231 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.231 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:44:22.232 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:44:22.232 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:44:22.232 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.232 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:44:22.232 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:44:22.232 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:44:22.232 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.232 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:44:22.232 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:44:22.232 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:44:22.232 INFO:tasks.workunit.client.0.smithi151.stdout:discard: 512~512 = 512 2024-09-16T07:44:22.232 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.232 INFO:tasks.workunit.client.0.smithi151.stdout:aio discard: 1536~512 = 0 2024-09-16T07:44:22.233 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:44:22.233 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:44:22.233 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:44:22.233 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:44:22.233 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:44:22.233 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 0 2024-09-16T07:44:22.233 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.233 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.233 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 0 2024-09-16T07:44:22.233 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.233 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.233 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 16384 2024-09-16T07:44:22.233 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.233 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.234 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 16384 2024-09-16T07:44:22.234 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.234 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.234 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:22.234 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:22.234 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 49152 2024-09-16T07:44:22.234 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.234 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.234 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 49152 2024-09-16T07:44:22.234 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.234 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.234 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 65536 2024-09-16T07:44:22.234 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.234 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.235 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 65536 2024-09-16T07:44:22.235 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.235 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.235 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:22.235 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:22.235 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 98304 2024-09-16T07:44:22.235 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.235 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.235 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 98304 2024-09-16T07:44:22.235 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.235 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.235 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 114688 2024-09-16T07:44:22.235 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.235 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.236 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 114688 2024-09-16T07:44:22.236 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.236 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.236 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:22.236 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:22.236 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 147456 2024-09-16T07:44:22.236 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.236 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.236 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 147456 2024-09-16T07:44:22.236 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.236 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.236 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 163840 2024-09-16T07:44:22.236 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.236 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.237 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 163840 2024-09-16T07:44:22.237 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.237 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.237 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:22.237 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:22.237 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 196608 2024-09-16T07:44:22.237 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.237 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.237 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 196608 2024-09-16T07:44:22.237 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.237 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.237 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 212992 2024-09-16T07:44:22.237 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.238 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.238 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 212992 2024-09-16T07:44:22.238 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.238 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.238 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:22.238 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:22.238 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.238 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:22.238 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.238 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.238 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:22.238 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.238 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.238 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.239 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:22.239 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.239 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.239 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:22.239 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.239 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.239 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.239 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:22.239 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.239 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.239 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:22.239 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.239 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.239 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.240 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:22.240 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.240 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.240 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:22.240 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.240 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.240 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.240 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:22.240 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:22.240 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.240 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:22.240 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:22.240 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.241 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:22.241 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.241 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.241 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:22.241 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.241 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.241 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:22.241 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:22.241 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:22.241 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:22.241 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:22.241 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:22.241 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:22.241 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.073 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.073 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:56.073 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:56.073 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:56.073 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:56.074 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:56.074 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.074 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.074 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:56.074 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:56.074 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:56.074 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:56.074 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:56.074 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.074 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.074 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:56.074 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.074 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.074 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:56.075 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.075 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.075 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:56.075 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:56.075 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:56.075 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:56.075 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:56.075 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.075 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.076 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:56.076 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:56.076 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:56.076 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:56.076 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:56.076 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.076 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.076 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:56.076 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:56.076 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:56.077 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:56.077 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:56.077 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.077 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.077 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:56.077 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:56.077 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:56.077 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:56.077 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:56.077 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.078 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.078 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:56.078 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.078 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.078 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:56.078 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.078 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.078 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:56.078 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:56.078 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:56.078 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:56.078 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:56.079 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.079 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.079 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:56.079 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:56.079 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:56.079 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:56.079 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:56.079 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.079 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.079 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:56.079 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:56.079 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:56.079 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:56.079 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:56.080 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.080 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.080 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:56.080 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:56.080 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:56.080 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:56.080 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:56.080 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.080 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.080 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:56.080 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.080 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.080 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:56.081 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.081 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.081 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:56.081 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:56.081 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:56.081 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:56.081 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:56.081 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.081 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.081 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:56.081 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:56.081 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:56.081 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:56.081 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:56.082 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.082 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.082 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:56.082 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:56.082 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:56.082 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:56.082 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:56.082 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.082 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.082 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:44:56.083 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:44:56.083 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:44:56.083 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:44:56.083 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:44:56.083 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.083 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.083 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:56.083 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:44:56.083 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:44:56.083 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:44:56.084 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:44:56.084 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:44:56.084 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:44:56.084 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:44:56.084 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 4 2024-09-16T07:44:56.084 INFO:tasks.workunit.client.0.smithi151.stdout:read: 4 2024-09-16T07:44:56.084 INFO:tasks.workunit.client.0.smithi151.stdout:read: 4 2024-09-16T07:44:56.084 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS2 (76257 ms) 2024-09-16T07:44:56.084 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCloneEncryption 2024-09-16T07:44:56.085 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2471: Skipped 2024-09-16T07:44:56.085 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:44:56.085 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestCloneEncryption (0 ms) 2024-09-16T07:44:56.085 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.LUKS1UnderLUKS2WithoutResize 2024-09-16T07:44:56.085 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2659: Skipped 2024-09-16T07:44:56.085 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:44:56.086 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.LUKS1UnderLUKS2WithoutResize (0 ms) 2024-09-16T07:44:56.086 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.LUKS2UnderLUKS1WithoutResize 2024-09-16T07:44:56.086 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2735: Skipped 2024-09-16T07:44:56.086 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:44:56.086 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.LUKS2UnderLUKS1WithoutResize (0 ms) 2024-09-16T07:44:56.086 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.EncryptionFormatNoData 2024-09-16T07:44:56.087 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:45:00.575 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.EncryptionFormatNoData (4504 ms) 2024-09-16T07:45:00.576 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadSize 2024-09-16T07:45:00.576 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:45:06.652 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.EncryptionLoadBadSize (6076 ms) 2024-09-16T07:45:06.652 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-16T07:45:06.653 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2905: Skipped 2024-09-16T07:45:06.653 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:45:06.653 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern (1 ms) 2024-09-16T07:45:06.653 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.EncryptionLoadFormatMismatch 2024-09-16T07:45:06.653 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2985: Skipped 2024-09-16T07:45:06.653 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:45:06.653 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadFormatMismatch (0 ms) 2024-09-16T07:45:06.653 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.EncryptedResize 2024-09-16T07:45:06.653 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:45:19.275 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.EncryptedResize (12622 ms) 2024-09-16T07:45:19.275 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.EncryptedFlattenSmallData 2024-09-16T07:45:19.275 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3202: Skipped 2024-09-16T07:45:19.275 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:45:19.275 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.EncryptedFlattenSmallData (0 ms) 2024-09-16T07:45:19.275 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestIOWithIOHint 2024-09-16T07:45:19.276 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:45:49.508 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:45:49.509 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:45:49.509 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:45:49.509 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:45:49.509 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:45:49.510 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.510 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:45:49.510 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.510 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.510 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:45:49.510 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.510 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:45:49.510 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.511 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.511 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:45:49.511 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.511 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:45:49.511 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.511 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.511 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:45:49.511 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.511 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:45:49.512 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.512 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.512 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:45:49.512 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.512 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:45:49.512 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.512 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.512 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:45:49.512 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:45:49.512 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:45:49.512 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:45:49.512 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:45:49.513 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:45:49.513 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:45:49.513 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:45:49.513 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:45:49.513 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:45:49.513 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:45:49.513 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.514 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:45:49.514 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.514 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.514 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:45:49.514 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.514 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:45:49.514 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.514 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.514 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:45:49.514 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.514 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:45:49.514 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.514 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.514 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:45:49.515 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.515 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:45:49.515 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.515 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.515 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:45:49.515 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.515 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:45:49.515 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.515 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.515 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:45:49.515 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:45:49.515 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:45:49.515 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:45:49.515 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:45:49.516 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:45:49.516 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.516 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:45:49.516 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:45:49.516 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:45:49.516 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.516 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:45:49.516 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:45:49.516 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:45:49.516 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.516 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:45:49.516 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:45:49.516 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:45:49.516 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.517 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:45:49.517 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:45:49.517 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:45:49.517 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.517 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:45:49.517 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:45:49.517 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:45:49.517 INFO:tasks.workunit.client.0.smithi151.stdout:discard: 512~512 = 512 2024-09-16T07:45:49.517 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.517 INFO:tasks.workunit.client.0.smithi151.stdout:aio discard: 1536~512 = 0 2024-09-16T07:45:49.517 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:45:49.518 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:45:49.518 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:45:49.518 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:45:49.518 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:45:49.518 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 0 2024-09-16T07:45:49.518 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.518 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.518 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 0 2024-09-16T07:45:49.518 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.519 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.519 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 16384 2024-09-16T07:45:49.519 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.519 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.519 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 16384 2024-09-16T07:45:49.519 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.519 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.519 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:45:49.519 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:45:49.519 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 49152 2024-09-16T07:45:49.519 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.519 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.519 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 49152 2024-09-16T07:45:49.520 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.520 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.520 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 65536 2024-09-16T07:45:49.520 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.520 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.520 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 65536 2024-09-16T07:45:49.520 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.520 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.520 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:45:49.520 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:45:49.520 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 98304 2024-09-16T07:45:49.520 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.520 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.520 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 98304 2024-09-16T07:45:49.521 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.521 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.521 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 114688 2024-09-16T07:45:49.521 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.521 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.521 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 114688 2024-09-16T07:45:49.521 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.521 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.521 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:45:49.521 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:45:49.521 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 147456 2024-09-16T07:45:49.522 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.522 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.522 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 147456 2024-09-16T07:45:49.522 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.522 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.522 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 163840 2024-09-16T07:45:49.522 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.522 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.522 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 163840 2024-09-16T07:45:49.522 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.522 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.522 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:45:49.522 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:45:49.522 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 196608 2024-09-16T07:45:49.523 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.523 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.523 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 196608 2024-09-16T07:45:49.523 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.523 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.523 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 212992 2024-09-16T07:45:49.523 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.523 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.523 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 212992 2024-09-16T07:45:49.523 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.523 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.523 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:45:49.523 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:45:49.524 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.524 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:45:49.524 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.524 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.524 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:45:49.524 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.524 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.524 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.524 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:45:49.524 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.524 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.524 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:45:49.524 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.525 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.525 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.525 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:45:49.525 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.525 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.525 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:45:49.525 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.525 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.525 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.525 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:45:49.525 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.525 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.525 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:45:49.526 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.526 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.526 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.526 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:45:49.526 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:45:49.526 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.526 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:45:49.526 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:45:49.526 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.526 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:45:49.526 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.526 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.526 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:45:49.527 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.527 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.527 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:45:49.527 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:45:49.527 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:45:49.527 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:45:49.527 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:45:49.527 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:45:49.527 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:45:49.527 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.604 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.604 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:15.604 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:15.604 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:15.604 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:15.605 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:15.605 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.605 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.605 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:15.605 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:15.605 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:15.605 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:15.605 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:15.605 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.605 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.605 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:15.605 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.605 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.606 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:15.606 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.606 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.606 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:15.606 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:15.606 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:15.606 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:15.606 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:15.606 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.606 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.606 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:15.606 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:15.606 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:15.606 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:15.607 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:15.607 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.607 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.607 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:15.607 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:15.607 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:15.607 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:15.607 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:15.607 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.607 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.607 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:15.607 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:15.607 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:15.607 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:15.608 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:15.608 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.608 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.608 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:15.608 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.608 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.608 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:15.608 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.608 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.608 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:15.608 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:15.608 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:15.608 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:15.609 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:15.609 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.609 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.609 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:15.609 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:15.609 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:15.609 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:15.609 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:15.609 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.609 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.610 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:15.610 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:15.610 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:15.610 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:15.610 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:15.610 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.610 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.610 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:15.610 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:15.611 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:15.611 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:15.611 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:15.612 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.612 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.612 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:15.612 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.612 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.612 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:15.612 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.612 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.612 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:15.612 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:15.612 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:15.612 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:15.612 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:15.613 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.613 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.613 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:15.613 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:15.613 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:15.613 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:15.613 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:15.613 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.613 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.613 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:15.613 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:15.613 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:15.614 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:15.614 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:15.614 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.614 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.614 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:15.614 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:15.614 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:15.614 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:15.614 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:15.614 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.614 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.614 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:15.614 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:15.614 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:15.615 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:15.615 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:46:15.615 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:46:15.615 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:46:15.615 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestIOWithIOHint (56329 ms) 2024-09-16T07:46:15.615 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestDataPoolIO 2024-09-16T07:46:15.615 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3947: Skipped 2024-09-16T07:46:15.615 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:46:15.615 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestDataPoolIO (0 ms) 2024-09-16T07:46:15.615 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatch 2024-09-16T07:46:15.615 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:15.774 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatch (171 ms) 2024-09-16T07:46:15.774 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatch 2024-09-16T07:46:15.774 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:15.997 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatch (222 ms) 2024-09-16T07:46:15.997 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccess 2024-09-16T07:46:15.997 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:16.184 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccess (188 ms) 2024-09-16T07:46:16.184 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccess 2024-09-16T07:46:16.184 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:16.365 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccess (181 ms) 2024-09-16T07:46:16.366 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned 2024-09-16T07:46:16.366 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:16.784 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned (419 ms) 2024-09-16T07:46:16.784 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned 2024-09-16T07:46:16.785 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:17.412 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned (628 ms) 2024-09-16T07:46:17.413 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLarge 2024-09-16T07:46:17.413 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:18.122 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLarge (709 ms) 2024-09-16T07:46:18.122 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLarge 2024-09-16T07:46:18.122 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:18.557 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLarge (435 ms) 2024-09-16T07:46:18.557 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess 2024-09-16T07:46:18.557 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:22.627 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess (4070 ms) 2024-09-16T07:46:22.627 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess 2024-09-16T07:46:22.628 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:26.905 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess (4279 ms) 2024-09-16T07:46:26.906 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers 2024-09-16T07:46:26.906 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:27.057 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers (151 ms) 2024-09-16T07:46:27.057 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVMismatch 2024-09-16T07:46:27.057 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:27.239 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVMismatch (183 ms) 2024-09-16T07:46:27.239 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVSuccess 2024-09-16T07:46:27.240 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:27.424 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVSuccess (185 ms) 2024-09-16T07:46:27.424 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestScatterGatherIO 2024-09-16T07:46:27.425 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:27.576 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestScatterGatherIO (152 ms) 2024-09-16T07:46:27.577 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestEmptyDiscard 2024-09-16T07:46:27.577 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:27.709 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:27.709 INFO:tasks.workunit.client.0.smithi151.stdout:aio discard: 0~1048576 = 0 2024-09-16T07:46:27.709 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:27.710 INFO:tasks.workunit.client.0.smithi151.stdout:aio discard: 0~4194304 = 0 2024-09-16T07:46:27.710 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:27.710 INFO:tasks.workunit.client.0.smithi151.stdout:aio discard: 3145728~1048576 = 0 2024-09-16T07:46:27.710 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestEmptyDiscard (132 ms) 2024-09-16T07:46:27.710 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestFUA 2024-09-16T07:46:27.710 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:28.273 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:46:28.274 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:46:28.274 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:46:28.274 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:46:28.274 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:46:28.274 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:46:28.274 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:46:28.274 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:46:28.274 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:46:28.274 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:46:28.274 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.274 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:46:28.274 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:28.274 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:28.274 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:46:28.275 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.275 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:46:28.275 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:28.275 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:28.275 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:46:28.275 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.275 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:46:28.275 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:28.275 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:28.275 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:46:28.275 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.275 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:46:28.275 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:28.275 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:28.276 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:46:28.276 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.276 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:46:28.276 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:28.276 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:28.276 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:46:28.276 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.276 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:46:28.276 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:46:28.276 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:46:28.276 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.276 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:46:28.277 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:46:28.277 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:46:28.277 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.277 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:46:28.277 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:46:28.277 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:46:28.277 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.277 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:46:28.277 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:46:28.277 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:46:28.277 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.277 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:46:28.277 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:46:28.278 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:46:28.278 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestFUA (565 ms) 2024-09-16T07:46:28.278 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestIOPP 2024-09-16T07:46:28.278 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:46:28.376 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:46:28.376 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:46:28.376 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:46:28.376 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:46:28.376 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:46:28.377 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.377 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:46:28.377 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:28.377 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:28.377 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:46:28.377 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.377 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:46:28.377 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:28.377 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:28.377 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:46:28.377 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.377 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:46:28.377 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:28.377 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:28.377 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:46:28.378 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.378 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:46:28.378 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:28.378 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:28.378 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:46:28.378 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.378 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:46:28.378 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:28.632 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:28.633 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:46:28.633 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:46:28.633 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:46:28.633 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:46:28.633 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:46:28.633 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:46:28.633 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:46:28.633 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:46:28.633 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:46:28.633 INFO:tasks.workunit.client.0.smithi151.stdout:start compare and write 2024-09-16T07:46:28.633 INFO:tasks.workunit.client.0.smithi151.stdout:compare and wrote: 512 2024-09-16T07:46:28.634 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.634 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:46:28.634 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:28.653 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:28.653 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:46:28.653 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.654 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:46:28.654 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:28.673 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:28.673 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:46:28.673 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.673 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:46:28.673 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:28.692 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:28.692 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:46:28.692 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.692 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:46:28.692 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:28.712 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:28.712 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:46:28.712 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.712 INFO:tasks.workunit.client.0.smithi151.stdout:started aio compare and write 2024-09-16T07:46:28.712 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:28.756 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:28.756 INFO:tasks.workunit.client.0.smithi151.stdout:finished aio compare and write 2024-09-16T07:46:28.756 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:46:28.757 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:46:28.757 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:46:28.757 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:46:28.757 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:46:28.757 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.757 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:46:28.757 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:46:28.763 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:46:28.764 INFO:tasks.workunit.client.0.smithi151.stdout:finished read 2024-09-16T07:46:28.764 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.764 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:46:28.764 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:46:28.769 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:46:28.769 INFO:tasks.workunit.client.0.smithi151.stdout:finished read 2024-09-16T07:46:28.769 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.770 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:46:28.770 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:46:28.774 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:46:28.774 INFO:tasks.workunit.client.0.smithi151.stdout:finished read 2024-09-16T07:46:28.775 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.775 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:46:28.775 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:46:28.788 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:46:28.789 INFO:tasks.workunit.client.0.smithi151.stdout:finished read 2024-09-16T07:46:28.789 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:28.789 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:46:28.789 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:46:28.789 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:46:28.789 INFO:tasks.workunit.client.0.smithi151.stdout:finished read 2024-09-16T07:46:28.789 INFO:tasks.workunit.client.0.smithi151.stdout:discard: 512~512 2024-09-16T07:46:28.789 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:52.564 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:46:52.564 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:46:52.565 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:46:52.565 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:46:52.565 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:46:52.565 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 0 2024-09-16T07:46:52.565 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.565 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.565 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 0 2024-09-16T07:46:52.565 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.565 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.565 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 16384 2024-09-16T07:46:52.565 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.565 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.565 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 16384 2024-09-16T07:46:52.566 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.566 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.566 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:52.566 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:52.566 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 49152 2024-09-16T07:46:52.566 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.566 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.566 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 49152 2024-09-16T07:46:52.566 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.567 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.567 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 65536 2024-09-16T07:46:52.567 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.567 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.567 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 65536 2024-09-16T07:46:52.567 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.567 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.567 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:52.567 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:52.568 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 98304 2024-09-16T07:46:52.568 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.568 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.568 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 98304 2024-09-16T07:46:52.568 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.568 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.568 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 114688 2024-09-16T07:46:52.568 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.568 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.568 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 114688 2024-09-16T07:46:52.568 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.569 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.569 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:52.569 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:52.569 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 147456 2024-09-16T07:46:52.569 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.569 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.569 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 147456 2024-09-16T07:46:52.569 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.570 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.570 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 163840 2024-09-16T07:46:52.570 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.570 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.570 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 163840 2024-09-16T07:46:52.570 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.570 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.570 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:52.571 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:52.571 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 196608 2024-09-16T07:46:52.571 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.571 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.571 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 196608 2024-09-16T07:46:52.571 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.571 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.571 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 212992 2024-09-16T07:46:52.571 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.572 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.572 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 212992 2024-09-16T07:46:52.572 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.572 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.572 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:52.572 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:52.572 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:52.573 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:52.573 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:52.573 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:52.573 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:52.573 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.574 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.574 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:52.574 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:52.574 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:52.574 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:52.574 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:52.574 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.574 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.575 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:52.575 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:52.575 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:52.785 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:52.786 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:52.786 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.786 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.786 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:52.786 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:52.786 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:52.985 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:52.985 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:52.985 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:52.985 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:52.985 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:52.985 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:52.985 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:52.985 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:52.986 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:52.986 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:52.986 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:52.986 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:52.986 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:53.691 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:53.691 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:53.691 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:53.691 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:53.691 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:53.691 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:53.691 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:54.123 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:54.123 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:54.123 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:54.123 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:54.123 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:54.123 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:54.123 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:54.987 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:54.987 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:54.987 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:54.987 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:54.987 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:54.987 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:54.987 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:55.554 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:55.554 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:55.554 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:55.555 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:55.555 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:55.555 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:55.555 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:55.555 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:55.555 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:55.555 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:46:55.555 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:55.555 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:55.555 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:56.890 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:56.890 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:56.890 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:56.890 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:56.890 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:56.890 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:56.890 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:57.813 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:57.813 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:57.813 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:57.813 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:57.813 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:57.813 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:57.813 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:46:59.277 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:46:59.278 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:46:59.278 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:46:59.278 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:46:59.278 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:46:59.278 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:46:59.278 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:00.262 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:00.262 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:00.263 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:00.263 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:00.263 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:00.263 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:00.263 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:00.263 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:00.263 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:00.263 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:00.263 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:00.263 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:00.263 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:02.248 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:02.248 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:02.248 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:02.248 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:02.249 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:02.249 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:02.249 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:03.541 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:03.541 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:03.541 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:03.541 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:03.541 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:03.541 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:03.541 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:05.775 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:05.775 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:05.775 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:05.775 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:05.776 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:05.776 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:05.776 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:07.205 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:07.205 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:07.205 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:07.205 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:07.205 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:07.205 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:07.206 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:07.206 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:07.206 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:07.206 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:07.206 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:07.206 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:07.206 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:09.799 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:09.800 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:09.800 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:09.800 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:09.800 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:09.800 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:09.800 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:11.495 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:11.495 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:11.495 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:11.496 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:11.496 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:11.496 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:11.496 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:14.369 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:14.370 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:14.370 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:14.370 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:14.370 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:14.370 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:14.371 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:16.213 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:16.213 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:16.214 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:16.214 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:16.214 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:16.214 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:16.214 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:16.214 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:16.214 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:16.214 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:16.214 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestIOPP (47940 ms) 2024-09-16T07:47:16.214 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP 2024-09-16T07:47:16.214 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:16.357 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP (144 ms) 2024-09-16T07:47:16.357 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP 2024-09-16T07:47:16.358 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:16.496 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP (138 ms) 2024-09-16T07:47:16.496 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP 2024-09-16T07:47:16.496 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:16.632 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP (137 ms) 2024-09-16T07:47:16.633 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP 2024-09-16T07:47:16.633 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:16.768 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP (135 ms) 2024-09-16T07:47:16.769 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchPP 2024-09-16T07:47:16.769 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:17.017 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchPP (249 ms) 2024-09-16T07:47:17.017 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchPP 2024-09-16T07:47:17.017 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:17.189 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:17.236 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchPP (219 ms) 2024-09-16T07:47:17.236 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-16T07:47:17.236 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:17.412 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP (176 ms) 2024-09-16T07:47:17.412 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-16T07:47:17.413 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:17.553 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:17.588 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP (174 ms) 2024-09-16T07:47:17.588 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessPP 2024-09-16T07:47:17.588 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:17.764 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessPP (177 ms) 2024-09-16T07:47:17.764 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessPP 2024-09-16T07:47:17.764 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:17.912 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:17.942 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessPP (179 ms) 2024-09-16T07:47:17.943 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-16T07:47:17.943 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:18.137 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP (195 ms) 2024-09-16T07:47:18.138 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-16T07:47:18.138 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:18.312 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:18.352 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP (215 ms) 2024-09-16T07:47:18.353 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP 2024-09-16T07:47:18.353 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:18.982 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP (629 ms) 2024-09-16T07:47:18.982 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP 2024-09-16T07:47:18.982 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:19.202 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:19.410 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP (428 ms) 2024-09-16T07:47:19.410 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLargePP 2024-09-16T07:47:19.410 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:19.955 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLargePP (545 ms) 2024-09-16T07:47:19.955 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLargePP 2024-09-16T07:47:19.955 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:20.212 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:20.519 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLargePP (564 ms) 2024-09-16T07:47:20.519 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP 2024-09-16T07:47:20.519 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:24.931 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP (4412 ms) 2024-09-16T07:47:24.931 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP 2024-09-16T07:47:24.931 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:28.972 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:29.376 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP (4446 ms) 2024-09-16T07:47:29.376 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestIOPPWithIOHint 2024-09-16T07:47:29.376 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:47:29.586 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:47:29.587 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:47:29.587 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:47:29.587 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:47:29.587 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:47:29.587 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:29.587 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:47:29.587 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:29.607 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:29.607 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:47:29.607 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:29.608 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:47:29.608 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:29.624 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:29.624 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:47:29.624 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:29.624 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:47:29.625 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:29.642 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:29.642 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:47:29.642 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:29.642 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:47:29.642 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:29.661 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:29.661 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:47:29.661 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:29.661 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:47:29.661 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:29.675 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:29.675 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:47:29.676 INFO:tasks.workunit.client.0.smithi151.stdout:read: 512 2024-09-16T07:47:29.676 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:29.676 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:47:29.676 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:47:29.682 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:47:29.683 INFO:tasks.workunit.client.0.smithi151.stdout:finished read 2024-09-16T07:47:29.683 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:29.683 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:47:29.683 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:47:29.689 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:47:29.689 INFO:tasks.workunit.client.0.smithi151.stdout:finished read 2024-09-16T07:47:29.689 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:29.689 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:47:29.689 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:47:29.695 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:47:29.695 INFO:tasks.workunit.client.0.smithi151.stdout:finished read 2024-09-16T07:47:29.695 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:29.695 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:47:29.695 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:47:29.701 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:47:29.701 INFO:tasks.workunit.client.0.smithi151.stdout:finished read 2024-09-16T07:47:29.702 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:29.702 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:47:29.702 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:47:53.680 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:47:53.680 INFO:tasks.workunit.client.0.smithi151.stdout:finished read 2024-09-16T07:47:53.680 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 0 2024-09-16T07:47:53.680 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.680 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.680 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 0 2024-09-16T07:47:53.680 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.680 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.681 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 16384 2024-09-16T07:47:53.681 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.681 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.681 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 16384 2024-09-16T07:47:53.681 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.681 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.681 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:53.681 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:53.681 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 49152 2024-09-16T07:47:53.681 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.681 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.681 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 49152 2024-09-16T07:47:53.682 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.682 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.682 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 65536 2024-09-16T07:47:53.682 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.682 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.682 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 65536 2024-09-16T07:47:53.682 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.682 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.682 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:53.682 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:53.682 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 98304 2024-09-16T07:47:53.682 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.682 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.683 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 98304 2024-09-16T07:47:53.683 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.683 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.683 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 114688 2024-09-16T07:47:53.683 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.683 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.683 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 114688 2024-09-16T07:47:53.683 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.683 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.683 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:53.683 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:53.683 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 147456 2024-09-16T07:47:53.683 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.684 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.684 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 147456 2024-09-16T07:47:53.684 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.684 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.684 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 163840 2024-09-16T07:47:53.684 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.684 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.684 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 163840 2024-09-16T07:47:53.684 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.684 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.684 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:53.684 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:53.684 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 196608 2024-09-16T07:47:53.684 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.685 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.685 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 196608 2024-09-16T07:47:53.685 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.685 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.685 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 212992 2024-09-16T07:47:53.685 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.685 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.685 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 212992 2024-09-16T07:47:53.685 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.685 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.685 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:53.685 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:53.685 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:53.686 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:53.686 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:53.686 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:53.686 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:53.686 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.686 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.686 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:53.686 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:53.686 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:53.697 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:53.698 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:53.698 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.698 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.698 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:53.698 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:53.698 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:53.920 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:53.920 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:53.920 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:53.920 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:53.920 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:53.920 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:53.920 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:54.079 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:54.079 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:54.079 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:54.079 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:54.079 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:54.079 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:54.079 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:54.079 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:54.079 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:54.079 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:54.079 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:54.079 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:54.080 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:54.732 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:54.732 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:54.732 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:54.732 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:54.732 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:54.732 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:54.733 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:55.175 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:55.176 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:55.176 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:55.176 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:55.176 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:55.176 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:55.176 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:56.017 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:56.017 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:56.017 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:56.017 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:56.017 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:56.018 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:56.018 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:56.601 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:56.601 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:56.601 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:56.601 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:56.602 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:56.602 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:56.602 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:56.602 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:56.602 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:56.602 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:47:56.602 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:56.602 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:56.602 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:58.003 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:58.003 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:58.003 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:58.004 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:58.004 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:58.004 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:58.004 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:47:58.910 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:47:58.911 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:47:58.911 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:47:58.911 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:47:58.911 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:47:58.911 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:47:58.911 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:48:00.437 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:48:00.438 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:48:00.438 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:48:00.438 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:48:00.438 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:00.438 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:48:00.438 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:48:01.515 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:48:01.515 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:48:01.515 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:48:01.515 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:48:01.515 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:01.516 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:48:01.516 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:48:01.516 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:01.516 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:48:01.516 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:48:01.516 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:01.516 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:48:01.516 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:48:03.422 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:48:03.422 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:48:03.422 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:48:03.422 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:48:03.422 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:03.422 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:48:03.423 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:48:04.706 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:48:04.706 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:48:04.706 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:48:04.706 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:48:04.706 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:04.707 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:48:04.707 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:48:06.957 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:48:06.957 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:48:06.958 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:48:06.958 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:48:06.958 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:06.958 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:48:06.958 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:48:08.443 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:48:08.443 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:48:08.443 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:48:08.443 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:48:08.443 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:08.443 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:48:08.444 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:48:08.444 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:08.444 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:48:08.444 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:48:08.444 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:08.444 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:48:08.444 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:48:11.054 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:48:11.054 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:48:11.054 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:48:11.054 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:48:11.055 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:11.055 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:48:11.055 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:48:12.772 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:48:12.772 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:48:12.772 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:48:12.772 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:48:12.772 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:12.772 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:48:12.772 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:48:15.643 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:48:15.643 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:48:15.643 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:48:15.643 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:48:15.643 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:15.643 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:48:15.643 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:48:17.625 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:48:17.625 INFO:tasks.workunit.client.0.smithi151.stdout:finished writesame 2024-09-16T07:48:17.625 INFO:tasks.workunit.client.0.smithi151.stdout:to verify the data 2024-09-16T07:48:17.625 INFO:tasks.workunit.client.0.smithi151.stdout:verified 2024-09-16T07:48:17.625 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:17.625 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:48:17.625 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:48:17.625 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:17.625 INFO:tasks.workunit.client.0.smithi151.stdout:started writesame 2024-09-16T07:48:17.625 INFO:tasks.workunit.client.0.smithi151.stdout:expected fail, finished writesame 2024-09-16T07:48:17.626 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestIOPPWithIOHint (48248 ms) 2024-09-16T07:48:17.626 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestIOToSnapshot 2024-09-16T07:48:17.626 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:19.956 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 0 2024-09-16T07:48:19.957 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 0 2024-09-16T07:48:19.957 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 1 2024-09-16T07:48:19.957 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 1 2024-09-16T07:48:19.957 INFO:tasks.workunit.client.0.smithi151.stdout:snap: orig 2024-09-16T07:48:19.957 INFO:tasks.workunit.client.0.smithi151.stdout:found orig with size 2097152 2024-09-16T07:48:19.957 INFO:tasks.workunit.client.0.smithi151.stdout:read: 80 2024-09-16T07:48:19.957 INFO:tasks.workunit.client.0.smithi151.stdout:write test data! 2024-09-16T07:48:19.957 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 80 2024-09-16T07:48:19.957 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 2 2024-09-16T07:48:19.957 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 2 2024-09-16T07:48:19.957 INFO:tasks.workunit.client.0.smithi151.stdout:snap: orig 2024-09-16T07:48:19.957 INFO:tasks.workunit.client.0.smithi151.stdout:snap: written 2024-09-16T07:48:19.958 INFO:tasks.workunit.client.0.smithi151.stdout:found orig with size 2097152 2024-09-16T07:48:19.958 INFO:tasks.workunit.client.0.smithi151.stdout:found written with size 2097152 2024-09-16T07:48:19.958 INFO:tasks.workunit.client.0.smithi151.stdout:read: 80 2024-09-16T07:48:19.958 INFO:tasks.workunit.client.0.smithi151.stdout:read: 80 2024-09-16T07:48:19.958 INFO:tasks.workunit.client.0.smithi151.stdout:read: 80 2024-09-16T07:48:19.958 INFO:tasks.workunit.client.0.smithi151.stdout:write to snapshot returned -30 2024-09-16T07:48:19.958 INFO:tasks.workunit.client.0.smithi151.stdout:Read-only file system 2024-09-16T07:48:20.097 INFO:tasks.workunit.client.0.smithi151.stdout:read: 80 2024-09-16T07:48:20.097 INFO:tasks.workunit.client.0.smithi151.stdout:read: 80 2024-09-16T07:48:20.097 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 80 2024-09-16T07:48:20.097 INFO:tasks.workunit.client.0.smithi151.stdout:opening testimg@orig 2024-09-16T07:48:20.097 INFO:tasks.workunit.client.0.smithi151.stdout:read: 80 2024-09-16T07:48:20.098 INFO:tasks.workunit.client.0.smithi151.stdout:write to snapshot returned -30 2024-09-16T07:48:20.098 INFO:tasks.workunit.client.0.smithi151.stdout:Read-only file system 2024-09-16T07:48:21.918 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 2 2024-09-16T07:48:21.918 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 2 2024-09-16T07:48:21.918 INFO:tasks.workunit.client.0.smithi151.stdout:snap: orig 2024-09-16T07:48:21.919 INFO:tasks.workunit.client.0.smithi151.stdout:snap: written 2024-09-16T07:48:21.919 INFO:tasks.workunit.client.0.smithi151.stdout:found orig with size 2097152 2024-09-16T07:48:21.919 INFO:tasks.workunit.client.0.smithi151.stdout:found written with size 2097152 2024-09-16T07:48:21.919 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 1 2024-09-16T07:48:21.919 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 1 2024-09-16T07:48:21.919 INFO:tasks.workunit.client.0.smithi151.stdout:snap: orig 2024-09-16T07:48:21.919 INFO:tasks.workunit.client.0.smithi151.stdout:found orig with size 2097152 2024-09-16T07:48:21.919 INFO:tasks.workunit.client.0.smithi151.stdout:num snaps is: 0 2024-09-16T07:48:21.919 INFO:tasks.workunit.client.0.smithi151.stdout:expected: 0 2024-09-16T07:48:21.919 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestIOToSnapshot (4294 ms) 2024-09-16T07:48:21.919 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestSnapshotDeletedIo 2024-09-16T07:48:21.919 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:23.942 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestSnapshotDeletedIo (2023 ms) 2024-09-16T07:48:23.942 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestClone 2024-09-16T07:48:23.942 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6444: Skipped 2024-09-16T07:48:23.942 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:23.942 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestClone (0 ms) 2024-09-16T07:48:23.943 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestClone2 2024-09-16T07:48:23.943 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6608: Skipped 2024-09-16T07:48:23.943 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:23.943 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestClone2 (0 ms) 2024-09-16T07:48:23.943 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ListChildren 2024-09-16T07:48:23.943 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6841: Skipped 2024-09-16T07:48:23.943 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:23.943 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ListChildren (0 ms) 2024-09-16T07:48:23.943 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ListChildrenTiered 2024-09-16T07:48:23.943 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6995: Skipped 2024-09-16T07:48:23.943 INFO:tasks.workunit.client.0.smithi151.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:48:23.943 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered (0 ms) 2024-09-16T07:48:23.944 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.LockingPP 2024-09-16T07:48:23.944 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:24.497 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.LockingPP (556 ms) 2024-09-16T07:48:24.498 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.FlushAio 2024-09-16T07:48:24.498 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:28.455 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.FlushAio (3957 ms) 2024-09-16T07:48:28.455 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.FlushAioPP 2024-09-16T07:48:28.455 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:32.629 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.FlushAioPP (4173 ms) 2024-09-16T07:48:32.629 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ZeroLengthWrite 2024-09-16T07:48:32.629 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:32.766 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.ZeroLengthWrite (139 ms) 2024-09-16T07:48:32.766 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ZeroLengthDiscard 2024-09-16T07:48:32.766 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:32.968 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.ZeroLengthDiscard (201 ms) 2024-09-16T07:48:32.968 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ZeroLengthRead 2024-09-16T07:48:32.968 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:33.121 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.ZeroLengthRead (153 ms) 2024-09-16T07:48:33.121 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.LargeCacheRead 2024-09-16T07:48:33.121 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:33.425 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.LargeCacheRead (304 ms) 2024-09-16T07:48:33.425 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestPendingAio 2024-09-16T07:48:33.426 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9152: Skipped 2024-09-16T07:48:33.426 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:33.426 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestPendingAio (0 ms) 2024-09-16T07:48:33.426 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyup 2024-09-16T07:48:33.426 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9264: Skipped 2024-09-16T07:48:33.426 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:33.426 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyup (0 ms) 2024-09-16T07:48:33.426 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-09-16T07:48:33.427 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9325: Skipped 2024-09-16T07:48:33.427 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:33.427 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyupMismatch (0 ms) 2024-09-16T07:48:33.427 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.Flatten 2024-09-16T07:48:33.427 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9336: Skipped 2024-09-16T07:48:33.427 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:33.427 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.Flatten (0 ms) 2024-09-16T07:48:33.428 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.Sparsify 2024-09-16T07:48:33.428 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:33.648 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 32768 2024-09-16T07:48:33.648 INFO:tasks.workunit.client.0.smithi151.stdout:read: 32768 2024-09-16T07:48:33.648 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.Sparsify (223 ms) 2024-09-16T07:48:33.648 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.SparsifyPP 2024-09-16T07:48:33.648 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:33.860 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.SparsifyPP (213 ms) 2024-09-16T07:48:33.860 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.SnapshotLimit 2024-09-16T07:48:33.860 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:38.923 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.SnapshotLimit (5062 ms) 2024-09-16T07:48:38.923 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.SnapshotLimitPP 2024-09-16T07:48:38.923 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:43.943 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.SnapshotLimitPP (5019 ms) 2024-09-16T07:48:43.943 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-09-16T07:48:43.943 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9523: Skipped 2024-09-16T07:48:43.943 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.944 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.RebuildObjectMapViaLockOwner (0 ms) 2024-09-16T07:48:43.944 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.RenameViaLockOwner 2024-09-16T07:48:43.944 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9575: Skipped 2024-09-16T07:48:43.944 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.944 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.RenameViaLockOwner (0 ms) 2024-09-16T07:48:43.944 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.SnapCreateViaLockOwner 2024-09-16T07:48:43.944 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9615: Skipped 2024-09-16T07:48:43.944 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.944 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SnapCreateViaLockOwner (0 ms) 2024-09-16T07:48:43.944 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.SnapRemoveViaLockOwner 2024-09-16T07:48:43.944 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9659: Skipped 2024-09-16T07:48:43.944 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.945 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveViaLockOwner (0 ms) 2024-09-16T07:48:43.945 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-09-16T07:48:43.945 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9699: Skipped 2024-09-16T07:48:43.945 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.945 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.UpdateFeaturesViaLockOwner (0 ms) 2024-09-16T07:48:43.945 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-16T07:48:43.945 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9736: Skipped 2024-09-16T07:48:43.945 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.946 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner (0 ms) 2024-09-16T07:48:43.946 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.SnapRemove2 2024-09-16T07:48:43.946 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9777: Skipped 2024-09-16T07:48:43.946 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.946 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SnapRemove2 (0 ms) 2024-09-16T07:48:43.946 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.SnapRenameViaLockOwner 2024-09-16T07:48:43.946 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9823: Skipped 2024-09-16T07:48:43.947 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.947 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SnapRenameViaLockOwner (0 ms) 2024-09-16T07:48:43.947 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.SnapProtectViaLockOwner 2024-09-16T07:48:43.947 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9864: Skipped 2024-09-16T07:48:43.947 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.947 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SnapProtectViaLockOwner (0 ms) 2024-09-16T07:48:43.947 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.SnapUnprotectViaLockOwner 2024-09-16T07:48:43.947 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9905: Skipped 2024-09-16T07:48:43.947 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.947 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SnapUnprotectViaLockOwner (0 ms) 2024-09-16T07:48:43.947 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.FlattenViaLockOwner 2024-09-16T07:48:43.947 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9949: Skipped 2024-09-16T07:48:43.947 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.948 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.FlattenViaLockOwner (0 ms) 2024-09-16T07:48:43.948 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ResizeViaLockOwner 2024-09-16T07:48:43.948 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9997: Skipped 2024-09-16T07:48:43.948 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.948 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ResizeViaLockOwner (0 ms) 2024-09-16T07:48:43.948 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.SparsifyViaLockOwner 2024-09-16T07:48:43.948 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10033: Skipped 2024-09-16T07:48:43.948 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.948 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SparsifyViaLockOwner (0 ms) 2024-09-16T07:48:43.948 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ObjectMapConsistentSnap 2024-09-16T07:48:43.948 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10069: Skipped 2024-09-16T07:48:43.948 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.948 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ObjectMapConsistentSnap (0 ms) 2024-09-16T07:48:43.948 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.Metadata 2024-09-16T07:48:43.949 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10121: Skipped 2024-09-16T07:48:43.949 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.949 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.Metadata (0 ms) 2024-09-16T07:48:43.949 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.MetadataPP 2024-09-16T07:48:43.949 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10310: Skipped 2024-09-16T07:48:43.949 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.949 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.MetadataPP (0 ms) 2024-09-16T07:48:43.949 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.UpdateFeatures 2024-09-16T07:48:43.949 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10391: Skipped 2024-09-16T07:48:43.949 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:43.949 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.UpdateFeatures (0 ms) 2024-09-16T07:48:43.950 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.FeaturesBitmaskString 2024-09-16T07:48:43.950 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.FeaturesBitmaskString (0 ms) 2024-09-16T07:48:43.950 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.RebuildObjectMap 2024-09-16T07:48:43.950 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:44.058 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.RebuildObjectMap (116 ms) 2024-09-16T07:48:44.058 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.RebuildNewObjectMap 2024-09-16T07:48:44.058 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10584: Skipped 2024-09-16T07:48:44.058 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:44.058 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.RebuildNewObjectMap (0 ms) 2024-09-16T07:48:44.058 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.CheckObjectMap 2024-09-16T07:48:44.058 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10609: Skipped 2024-09-16T07:48:44.059 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:44.059 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.CheckObjectMap (0 ms) 2024-09-16T07:48:44.059 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.BlockingAIO 2024-09-16T07:48:44.059 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:44.207 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.BlockingAIO (149 ms) 2024-09-16T07:48:44.207 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ExclusiveLockTransition 2024-09-16T07:48:44.207 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10737: Skipped 2024-09-16T07:48:44.207 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:44.207 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockTransition (0 ms) 2024-09-16T07:48:44.207 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ExclusiveLockReadTransition 2024-09-16T07:48:44.208 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10793: Skipped 2024-09-16T07:48:44.208 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:44.208 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition (0 ms) 2024-09-16T07:48:44.208 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.CacheMayCopyOnWrite 2024-09-16T07:48:44.208 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10846: Skipped 2024-09-16T07:48:44.208 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:44.208 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.CacheMayCopyOnWrite (0 ms) 2024-09-16T07:48:44.208 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot 2024-09-16T07:48:44.208 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:45.083 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot (877 ms) 2024-09-16T07:48:45.084 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestImageOptions 2024-09-16T07:48:49.862 INFO:tasks.workunit.client.0.smithi151.stdout:0.00% done 2024-09-16T07:48:49.862 INFO:tasks.workunit.client.0.smithi151.stdout:100.00% done 2024-09-16T07:48:49.862 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestImageOptions (4778 ms) 2024-09-16T07:48:49.862 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestImageOptionsPP 2024-09-16T07:48:52.252 INFO:tasks.workunit.client.0.smithi151.stdout:0.00% done 2024-09-16T07:48:52.252 INFO:tasks.workunit.client.0.smithi151.stdout:100.00% done 2024-09-16T07:48:52.252 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestImageOptionsPP (2389 ms) 2024-09-16T07:48:52.252 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.EventSocketPipe 2024-09-16T07:48:52.253 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.EventSocketPipe (0 ms) 2024-09-16T07:48:52.253 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.EventSocketEventfd 2024-09-16T07:48:52.253 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.EventSocketEventfd (0 ms) 2024-09-16T07:48:52.253 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ImagePollIO 2024-09-16T07:48:52.253 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:52.631 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:48:52.631 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:48:52.631 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:48:52.632 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:48:52.632 INFO:tasks.workunit.client.0.smithi151.stdout:wrote: 512 2024-09-16T07:48:52.632 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:52.632 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:48:52.632 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:48:52.632 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:48:52.632 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:48:52.632 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:52.632 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:48:52.632 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:48:52.632 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:48:52.633 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:48:52.633 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:52.633 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:48:52.633 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:48:52.633 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:48:52.633 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:48:52.633 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:52.633 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:48:52.633 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:48:52.633 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:48:52.633 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:48:52.633 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:52.633 INFO:tasks.workunit.client.0.smithi151.stdout:started write 2024-09-16T07:48:52.633 INFO:tasks.workunit.client.0.smithi151.stdout:write completion cb called! 2024-09-16T07:48:52.634 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 0 2024-09-16T07:48:52.634 INFO:tasks.workunit.client.0.smithi151.stdout:finished write 2024-09-16T07:48:52.634 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:52.634 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:48:52.634 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:48:52.634 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:48:52.634 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:52.634 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:48:52.634 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:48:52.634 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:48:52.634 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:52.634 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:48:52.635 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:48:52.635 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:48:52.635 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:52.635 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:48:52.635 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:48:52.635 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:48:52.635 INFO:tasks.workunit.client.0.smithi151.stdout:created completion 2024-09-16T07:48:52.635 INFO:tasks.workunit.client.0.smithi151.stdout:started read 2024-09-16T07:48:52.635 INFO:tasks.workunit.client.0.smithi151.stdout:read completion cb called! 2024-09-16T07:48:52.635 INFO:tasks.workunit.client.0.smithi151.stdout:return value is: 512 2024-09-16T07:48:52.635 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.ImagePollIO (381 ms) 2024-09-16T07:48:52.635 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.Mirror 2024-09-16T07:48:52.701 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:52.752 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:53.349 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.Mirror (717 ms) 2024-09-16T07:48:53.349 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.MirrorPeerAttributes 2024-09-16T07:48:53.510 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.MirrorPeerAttributes (162 ms) 2024-09-16T07:48:53.511 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.CreateWithMirrorEnabled 2024-09-16T07:48:53.511 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11322: Skipped 2024-09-16T07:48:53.511 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:53.511 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.CreateWithMirrorEnabled (0 ms) 2024-09-16T07:48:53.511 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-09-16T07:48:53.511 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11364: Skipped 2024-09-16T07:48:53.511 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:53.511 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot (0 ms) 2024-09-16T07:48:53.511 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ExclusiveLock 2024-09-16T07:48:53.511 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11410: Skipped 2024-09-16T07:48:53.511 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:53.511 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLock (0 ms) 2024-09-16T07:48:53.512 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.BreakLock 2024-09-16T07:48:53.512 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11553: Skipped 2024-09-16T07:48:53.512 INFO:tasks.workunit.client.0.smithi151.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:48:53.512 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.BreakLock (0 ms) 2024-09-16T07:48:53.512 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.DiscardAfterWrite 2024-09-16T07:48:53.512 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:53.629 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.DiscardAfterWrite (117 ms) 2024-09-16T07:48:53.629 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.DefaultFeatures 2024-09-16T07:48:53.629 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.DefaultFeatures (0 ms) 2024-09-16T07:48:53.629 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurge 2024-09-16T07:48:53.629 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11676: Skipped 2024-09-16T07:48:53.629 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:53.629 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurge (0 ms) 2024-09-16T07:48:53.629 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-09-16T07:48:53.629 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11722: Skipped 2024-09-16T07:48:53.629 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:53.630 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay (0 ms) 2024-09-16T07:48:53.630 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestTrashPurge 2024-09-16T07:48:53.630 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11753: Skipped 2024-09-16T07:48:53.630 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:53.630 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestTrashPurge (0 ms) 2024-09-16T07:48:53.630 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndRestore 2024-09-16T07:48:53.630 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11810: Skipped 2024-09-16T07:48:53.630 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:48:53.630 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndRestore (0 ms) 2024-09-16T07:48:53.630 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestListWatchers 2024-09-16T07:48:53.630 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:53.855 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestListWatchers (226 ms) 2024-09-16T07:48:53.855 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestSetSnapById 2024-09-16T07:48:53.855 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:54.712 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.TestSetSnapById (858 ms) 2024-09-16T07:48:54.713 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.Namespaces 2024-09-16T07:48:55.049 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.Namespaces (337 ms) 2024-09-16T07:48:55.050 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.NamespacesPP 2024-09-16T07:48:55.457 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:55.472 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.NamespacesPP (423 ms) 2024-09-16T07:48:55.472 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.Migration 2024-09-16T07:48:55.472 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:48:55.472 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:49:00.040 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.Migration (4567 ms) 2024-09-16T07:49:00.040 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.MigrationPP 2024-09-16T07:49:00.040 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:49:00.040 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:49:04.577 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.MigrationPP (4536 ms) 2024-09-16T07:49:04.577 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestGetAccessTimestamp 2024-09-16T07:49:04.577 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12177: Skipped 2024-09-16T07:49:04.577 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:04.577 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestGetAccessTimestamp (0 ms) 2024-09-16T07:49:04.577 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.TestGetModifyTimestamp 2024-09-16T07:49:04.577 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12202: Skipped 2024-09-16T07:49:04.578 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:04.578 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestGetModifyTimestamp (0 ms) 2024-09-16T07:49:04.578 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ZeroOverlapFlatten 2024-09-16T07:49:04.578 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12225: Skipped 2024-09-16T07:49:04.578 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:04.578 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ZeroOverlapFlatten (0 ms) 2024-09-16T07:49:04.578 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.PoolMetadata 2024-09-16T07:49:04.578 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12258: Skipped 2024-09-16T07:49:04.578 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:04.578 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.PoolMetadata (0 ms) 2024-09-16T07:49:04.578 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.PoolMetadataPP 2024-09-16T07:49:04.578 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12370: Skipped 2024-09-16T07:49:04.578 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:04.579 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.PoolMetadataPP (0 ms) 2024-09-16T07:49:04.579 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.Config 2024-09-16T07:49:04.579 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12422: Skipped 2024-09-16T07:49:04.579 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:04.579 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.Config (0 ms) 2024-09-16T07:49:04.579 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ConfigPP 2024-09-16T07:49:04.579 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12506: Skipped 2024-09-16T07:49:04.579 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:04.579 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ConfigPP (0 ms) 2024-09-16T07:49:04.579 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.PoolStatsPP 2024-09-16T07:49:04.579 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12583: Skipped 2024-09-16T07:49:04.579 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:04.579 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.PoolStatsPP (0 ms) 2024-09-16T07:49:04.580 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ImageSpec 2024-09-16T07:49:04.580 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12658: Skipped 2024-09-16T07:49:04.580 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:04.580 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ImageSpec (0 ms) 2024-09-16T07:49:04.580 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.SnapRemoveWithChildMissing 2024-09-16T07:49:04.580 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12853: Skipped 2024-09-16T07:49:04.580 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:04.580 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveWithChildMissing (0 ms) 2024-09-16T07:49:04.580 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.QuiesceWatch 2024-09-16T07:49:04.580 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:49:10.914 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.QuiesceWatch (6339 ms) 2024-09-16T07:49:10.915 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.QuiesceWatchPP 2024-09-16T07:49:10.915 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:49:17.006 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.QuiesceWatchPP (6091 ms) 2024-09-16T07:49:17.007 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.QuiesceWatchError 2024-09-16T07:49:17.007 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13115: Skipped 2024-09-16T07:49:17.007 INFO:tasks.workunit.client.0.smithi151.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:49:17.007 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError (0 ms) 2024-09-16T07:49:17.007 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.QuiesceWatchTimeout 2024-09-16T07:49:17.007 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:49:17.133 INFO:tasks.workunit.client.0.smithi151.stderr:test quiesce is not long enough to time out 2024-09-16T07:49:25.810 INFO:tasks.workunit.client.0.smithi151.stderr:test quiesce is timed out 2024-09-16T07:49:25.834 INFO:tasks.workunit.client.0.smithi151.stderr:waiting for timed out ... 0 2024-09-16T07:49:26.834 INFO:tasks.workunit.client.0.smithi151.stderr:waiting for timed out ... 1 2024-09-16T07:49:27.834 INFO:tasks.workunit.client.0.smithi151.stderr:waiting for timed out ... 2 2024-09-16T07:49:28.834 INFO:tasks.workunit.client.0.smithi151.stderr:waiting for timed out ... 3 2024-09-16T07:49:29.834 INFO:tasks.workunit.client.0.smithi151.stderr:waiting for timed out ... 4 2024-09-16T07:49:30.835 INFO:tasks.workunit.client.0.smithi151.stderr:waiting for timed out ... 5 2024-09-16T07:49:31.835 INFO:tasks.workunit.client.0.smithi151.stderr:waiting for timed out ... 6 2024-09-16T07:49:32.835 INFO:tasks.workunit.client.0.smithi151.stderr:waiting for timed out ... 7 2024-09-16T07:49:33.835 INFO:tasks.workunit.client.0.smithi151.stderr:waiting for timed out ... 8 2024-09-16T07:49:34.835 INFO:tasks.workunit.client.0.smithi151.stderr:waiting for timed out ... 9 2024-09-16T07:49:35.835 INFO:tasks.workunit.client.0.smithi151.stderr:waiting for timed out ... 10 2024-09-16T07:49:46.835 INFO:tasks.workunit.client.0.smithi151.stderr:test retry succeeds 2024-09-16T07:49:50.033 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.QuiesceWatchTimeout (33028 ms) 2024-09-16T07:49:50.034 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.WriteZeroes 2024-09-16T07:49:50.034 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:49:50.268 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.WriteZeroes (235 ms) 2024-09-16T07:49:50.268 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.WriteZeroesThickProvision 2024-09-16T07:49:50.268 INFO:tasks.workunit.client.0.smithi151.stdout:using old format 2024-09-16T07:49:50.602 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestLibRBD.WriteZeroesThickProvision (333 ms) 2024-09-16T07:49:50.602 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.ConcurrentOperations 2024-09-16T07:49:50.602 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13474: Skipped 2024-09-16T07:49:50.602 INFO:tasks.workunit.client.0.smithi151.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:49:50.602 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations (0 ms) 2024-09-16T07:49:50.602 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestLibRBD.FormatAndCloneFormatOptions 2024-09-16T07:49:50.602 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13630: Skipped 2024-09-16T07:49:50.602 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:50.602 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.FormatAndCloneFormatOptions (0 ms) 2024-09-16T07:49:57.620 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 171 tests from TestLibRBD (600991 ms total) 2024-09-16T07:49:57.621 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:49:57.621 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:49:57.621 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 171 tests from 1 test suite ran. (608055 ms total) 2024-09-16T07:49:57.621 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 104 tests. 2024-09-16T07:49:57.621 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 67 tests, listed below: 2024-09-16T07:49:57.621 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.CreateWithSameDataPool 2024-09-16T07:49:57.621 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestGetCreateTimestamp 2024-09-16T07:49:57.621 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.GetCreateTimestampPP 2024-09-16T07:49:57.621 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopy 2024-09-16T07:49:57.621 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopyPP 2024-09-16T07:49:57.621 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestGetSnapShotTimeStamp 2024-09-16T07:49:57.621 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryDataPool 2024-09-16T07:49:57.621 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespace 2024-09-16T07:49:57.622 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespaceDataPool 2024-09-16T07:49:57.622 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestCloneEncryption 2024-09-16T07:49:57.622 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.LUKS1UnderLUKS2WithoutResize 2024-09-16T07:49:57.622 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.LUKS2UnderLUKS1WithoutResize 2024-09-16T07:49:57.622 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-16T07:49:57.622 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadFormatMismatch 2024-09-16T07:49:57.622 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.EncryptedFlattenSmallData 2024-09-16T07:49:57.622 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestDataPoolIO 2024-09-16T07:49:57.622 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestClone 2024-09-16T07:49:57.622 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestClone2 2024-09-16T07:49:57.622 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ListChildren 2024-09-16T07:49:57.622 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered 2024-09-16T07:49:57.622 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestPendingAio 2024-09-16T07:49:57.622 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyup 2024-09-16T07:49:57.623 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-09-16T07:49:57.623 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.Flatten 2024-09-16T07:49:57.623 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-09-16T07:49:57.623 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.RenameViaLockOwner 2024-09-16T07:49:57.623 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SnapCreateViaLockOwner 2024-09-16T07:49:57.623 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveViaLockOwner 2024-09-16T07:49:57.623 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-09-16T07:49:57.623 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-16T07:49:57.623 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SnapRemove2 2024-09-16T07:49:57.623 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SnapRenameViaLockOwner 2024-09-16T07:49:57.623 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SnapProtectViaLockOwner 2024-09-16T07:49:57.623 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SnapUnprotectViaLockOwner 2024-09-16T07:49:57.623 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.FlattenViaLockOwner 2024-09-16T07:49:57.623 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ResizeViaLockOwner 2024-09-16T07:49:57.624 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SparsifyViaLockOwner 2024-09-16T07:49:57.624 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ObjectMapConsistentSnap 2024-09-16T07:49:57.624 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.Metadata 2024-09-16T07:49:57.624 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.MetadataPP 2024-09-16T07:49:57.624 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.UpdateFeatures 2024-09-16T07:49:57.624 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.RebuildNewObjectMap 2024-09-16T07:49:57.624 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.CheckObjectMap 2024-09-16T07:49:57.625 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockTransition 2024-09-16T07:49:57.625 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition 2024-09-16T07:49:57.625 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.CacheMayCopyOnWrite 2024-09-16T07:49:57.625 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.CreateWithMirrorEnabled 2024-09-16T07:49:57.625 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-09-16T07:49:57.625 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLock 2024-09-16T07:49:57.625 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.BreakLock 2024-09-16T07:49:57.625 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurge 2024-09-16T07:49:57.625 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-09-16T07:49:57.625 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestTrashPurge 2024-09-16T07:49:57.625 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndRestore 2024-09-16T07:49:57.625 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestGetAccessTimestamp 2024-09-16T07:49:57.625 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.TestGetModifyTimestamp 2024-09-16T07:49:57.626 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ZeroOverlapFlatten 2024-09-16T07:49:57.626 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.PoolMetadata 2024-09-16T07:49:57.626 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.PoolMetadataPP 2024-09-16T07:49:57.626 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.Config 2024-09-16T07:49:57.626 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ConfigPP 2024-09-16T07:49:57.626 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.PoolStatsPP 2024-09-16T07:49:57.626 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ImageSpec 2024-09-16T07:49:57.626 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveWithChildMissing 2024-09-16T07:49:57.626 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError 2024-09-16T07:49:57.626 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations 2024-09-16T07:49:57.626 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestLibRBD.FormatAndCloneFormatOptions 2024-09-16T07:49:57.626 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:49:57.626 INFO:tasks.workunit.client.0.smithi151.stdout: YOU HAVE 1 DISABLED TEST 2024-09-16T07:49:57.626 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:49:57.687 INFO:tasks.workunit.client.0.smithi151.stdout:seed 31259 2024-09-16T07:49:57.687 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = EncryptedFlattenTest/0.* 2024-09-16T07:49:57.687 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T07:49:57.688 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:49:57.688 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/0, where TypeParam = PlaintextUnderLUKS1 2024-09-16T07:49:57.783 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/0.Simple 2024-09-16T07:49:59.645 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T07:49:59.645 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:59.645 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Simple (1861 ms) 2024-09-16T07:49:59.645 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/0.Grow 2024-09-16T07:49:59.645 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T07:49:59.645 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:59.645 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Grow (0 ms) 2024-09-16T07:49:59.645 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/0.Shrink 2024-09-16T07:49:59.645 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T07:49:59.646 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:59.646 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Shrink (0 ms) 2024-09-16T07:49:59.646 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOne 2024-09-16T07:49:59.646 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T07:49:59.646 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:59.646 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOne (0 ms) 2024-09-16T07:49:59.646 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot 2024-09-16T07:49:59.646 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T07:49:59.646 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:59.646 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T07:49:59.646 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/0.MinOverlap 2024-09-16T07:49:59.647 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T07:49:59.647 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:59.647 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/0.MinOverlap (0 ms) 2024-09-16T07:49:59.647 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/0.ZeroOverlap 2024-09-16T07:49:59.647 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T07:49:59.647 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:49:59.647 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ZeroOverlap (0 ms) 2024-09-16T07:50:00.643 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/0 (1861 ms total) 2024-09-16T07:50:00.643 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:50:00.643 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:50:00.643 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 7 tests from 1 test suite ran. (2955 ms total) 2024-09-16T07:50:00.643 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 0 tests. 2024-09-16T07:50:00.643 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T07:50:00.643 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Simple 2024-09-16T07:50:00.643 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Grow 2024-09-16T07:50:00.643 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Shrink 2024-09-16T07:50:00.643 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOne 2024-09-16T07:50:00.643 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot 2024-09-16T07:50:00.643 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/0.MinOverlap 2024-09-16T07:50:00.644 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ZeroOverlap 2024-09-16T07:50:00.707 INFO:tasks.workunit.client.0.smithi151.stdout:seed 31323 2024-09-16T07:50:00.708 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = EncryptedFlattenTest/1.* 2024-09-16T07:50:00.708 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T07:50:00.708 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:50:00.708 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/1, where TypeParam = PlaintextUnderLUKS2 2024-09-16T07:50:00.783 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/1.Simple 2024-09-16T07:50:02.656 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T07:50:02.656 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:02.657 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Simple (1872 ms) 2024-09-16T07:50:02.657 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/1.Grow 2024-09-16T07:50:02.657 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T07:50:02.657 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:02.657 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Grow (0 ms) 2024-09-16T07:50:02.657 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/1.Shrink 2024-09-16T07:50:02.657 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T07:50:02.657 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:02.657 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Shrink (0 ms) 2024-09-16T07:50:02.657 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOne 2024-09-16T07:50:02.657 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T07:50:02.657 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:02.657 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOne (0 ms) 2024-09-16T07:50:02.658 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot 2024-09-16T07:50:02.658 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T07:50:02.658 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:02.658 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T07:50:02.658 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/1.MinOverlap 2024-09-16T07:50:02.658 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T07:50:02.658 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:02.658 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/1.MinOverlap (0 ms) 2024-09-16T07:50:02.658 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/1.ZeroOverlap 2024-09-16T07:50:02.658 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T07:50:02.658 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:02.658 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ZeroOverlap (0 ms) 2024-09-16T07:50:03.663 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/1 (1872 ms total) 2024-09-16T07:50:03.663 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:50:03.663 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:50:03.663 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 7 tests from 1 test suite ran. (2954 ms total) 2024-09-16T07:50:03.663 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 0 tests. 2024-09-16T07:50:03.664 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T07:50:03.664 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Simple 2024-09-16T07:50:03.664 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Grow 2024-09-16T07:50:03.664 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Shrink 2024-09-16T07:50:03.664 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOne 2024-09-16T07:50:03.664 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot 2024-09-16T07:50:03.664 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/1.MinOverlap 2024-09-16T07:50:03.664 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ZeroOverlap 2024-09-16T07:50:03.727 INFO:tasks.workunit.client.0.smithi151.stdout:seed 31387 2024-09-16T07:50:03.727 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = EncryptedFlattenTest/2.* 2024-09-16T07:50:03.727 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T07:50:03.728 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:50:03.728 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/2, where TypeParam = UnformattedLUKS1 2024-09-16T07:50:03.828 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/2.Simple 2024-09-16T07:50:05.669 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T07:50:05.669 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:05.669 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Simple (1841 ms) 2024-09-16T07:50:05.669 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/2.Grow 2024-09-16T07:50:05.669 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T07:50:05.669 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:05.669 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Grow (0 ms) 2024-09-16T07:50:05.669 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/2.Shrink 2024-09-16T07:50:05.669 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T07:50:05.669 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Shrink (0 ms) 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOne 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOne (0 ms) 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/2.MinOverlap 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/2.MinOverlap (0 ms) 2024-09-16T07:50:05.671 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/2.ZeroOverlap 2024-09-16T07:50:05.671 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T07:50:05.671 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:05.671 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ZeroOverlap (0 ms) 2024-09-16T07:50:06.672 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/2 (1841 ms total) 2024-09-16T07:50:06.672 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:50:06.672 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:50:06.672 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 7 tests from 1 test suite ran. (2944 ms total) 2024-09-16T07:50:06.672 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 0 tests. 2024-09-16T07:50:06.672 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T07:50:06.672 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Simple 2024-09-16T07:50:06.672 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Grow 2024-09-16T07:50:06.672 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Shrink 2024-09-16T07:50:06.672 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOne 2024-09-16T07:50:06.672 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot 2024-09-16T07:50:06.673 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/2.MinOverlap 2024-09-16T07:50:06.673 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ZeroOverlap 2024-09-16T07:50:06.737 INFO:tasks.workunit.client.0.smithi151.stdout:seed 31451 2024-09-16T07:50:06.737 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = EncryptedFlattenTest/3.* 2024-09-16T07:50:06.737 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T07:50:06.737 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:50:06.738 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/3, where TypeParam = LUKS1UnderLUKS1 2024-09-16T07:50:06.834 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/3.Simple 2024-09-16T07:50:08.687 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T07:50:08.687 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:08.687 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Simple (1852 ms) 2024-09-16T07:50:08.687 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/3.Grow 2024-09-16T07:50:08.688 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T07:50:08.688 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:08.688 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Grow (0 ms) 2024-09-16T07:50:08.688 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/3.Shrink 2024-09-16T07:50:08.688 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T07:50:08.688 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:08.688 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Shrink (1 ms) 2024-09-16T07:50:08.688 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOne 2024-09-16T07:50:08.688 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T07:50:08.688 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:08.689 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOne (0 ms) 2024-09-16T07:50:08.689 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot 2024-09-16T07:50:08.689 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T07:50:08.689 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:08.689 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T07:50:08.689 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/3.MinOverlap 2024-09-16T07:50:08.689 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T07:50:08.689 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:08.689 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/3.MinOverlap (0 ms) 2024-09-16T07:50:08.689 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/3.ZeroOverlap 2024-09-16T07:50:08.690 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T07:50:08.690 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:08.690 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ZeroOverlap (0 ms) 2024-09-16T07:50:09.702 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/3 (1853 ms total) 2024-09-16T07:50:09.703 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:50:09.703 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:50:09.703 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 7 tests from 1 test suite ran. (2965 ms total) 2024-09-16T07:50:09.703 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 0 tests. 2024-09-16T07:50:09.703 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T07:50:09.703 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Simple 2024-09-16T07:50:09.703 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Grow 2024-09-16T07:50:09.703 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Shrink 2024-09-16T07:50:09.703 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOne 2024-09-16T07:50:09.703 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot 2024-09-16T07:50:09.703 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/3.MinOverlap 2024-09-16T07:50:09.703 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ZeroOverlap 2024-09-16T07:50:09.784 INFO:tasks.workunit.client.0.smithi151.stdout:seed 31518 2024-09-16T07:50:09.785 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = EncryptedFlattenTest/4.* 2024-09-16T07:50:09.785 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T07:50:09.785 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:50:09.785 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/4, where TypeParam = LUKS1UnderLUKS2 2024-09-16T07:50:09.877 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/4.Simple 2024-09-16T07:50:11.707 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T07:50:11.708 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:11.708 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Simple (1830 ms) 2024-09-16T07:50:11.708 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/4.Grow 2024-09-16T07:50:11.708 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T07:50:11.708 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:11.708 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Grow (0 ms) 2024-09-16T07:50:11.708 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/4.Shrink 2024-09-16T07:50:11.708 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T07:50:11.708 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:11.708 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Shrink (0 ms) 2024-09-16T07:50:11.709 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOne 2024-09-16T07:50:11.709 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T07:50:11.709 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:11.709 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOne (0 ms) 2024-09-16T07:50:11.709 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot 2024-09-16T07:50:11.709 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T07:50:11.709 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:11.709 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T07:50:11.709 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/4.MinOverlap 2024-09-16T07:50:11.709 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T07:50:11.709 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:11.710 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/4.MinOverlap (0 ms) 2024-09-16T07:50:11.710 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/4.ZeroOverlap 2024-09-16T07:50:11.710 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T07:50:11.710 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:11.710 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ZeroOverlap (0 ms) 2024-09-16T07:50:12.507 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/4 (1830 ms total) 2024-09-16T07:50:12.507 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:50:12.507 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:50:12.507 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 7 tests from 1 test suite ran. (2722 ms total) 2024-09-16T07:50:12.507 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 0 tests. 2024-09-16T07:50:12.507 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T07:50:12.507 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Simple 2024-09-16T07:50:12.507 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Grow 2024-09-16T07:50:12.508 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Shrink 2024-09-16T07:50:12.508 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOne 2024-09-16T07:50:12.508 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot 2024-09-16T07:50:12.508 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/4.MinOverlap 2024-09-16T07:50:12.508 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ZeroOverlap 2024-09-16T07:50:12.572 INFO:tasks.workunit.client.0.smithi151.stdout:seed 31582 2024-09-16T07:50:12.573 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = EncryptedFlattenTest/5.* 2024-09-16T07:50:12.573 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T07:50:12.573 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:50:12.573 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/5, where TypeParam = UnformattedLUKS2 2024-09-16T07:50:12.671 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/5.Simple 2024-09-16T07:50:14.713 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T07:50:14.713 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:14.713 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Simple (2040 ms) 2024-09-16T07:50:14.713 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/5.Grow 2024-09-16T07:50:14.713 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T07:50:14.713 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:14.713 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Grow (0 ms) 2024-09-16T07:50:14.714 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/5.Shrink 2024-09-16T07:50:14.714 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T07:50:14.714 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:14.714 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Shrink (0 ms) 2024-09-16T07:50:14.714 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOne 2024-09-16T07:50:14.714 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T07:50:14.714 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:14.714 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOne (0 ms) 2024-09-16T07:50:14.714 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot 2024-09-16T07:50:14.714 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T07:50:14.714 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:14.714 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T07:50:14.715 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/5.MinOverlap 2024-09-16T07:50:14.715 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T07:50:14.715 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:14.715 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/5.MinOverlap (0 ms) 2024-09-16T07:50:14.715 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/5.ZeroOverlap 2024-09-16T07:50:14.715 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T07:50:14.715 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:14.715 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ZeroOverlap (0 ms) 2024-09-16T07:50:15.715 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/5 (2040 ms total) 2024-09-16T07:50:15.716 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:50:15.716 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:50:15.716 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 7 tests from 1 test suite ran. (3143 ms total) 2024-09-16T07:50:15.716 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 0 tests. 2024-09-16T07:50:15.716 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T07:50:15.716 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Simple 2024-09-16T07:50:15.716 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Grow 2024-09-16T07:50:15.717 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Shrink 2024-09-16T07:50:15.717 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOne 2024-09-16T07:50:15.717 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot 2024-09-16T07:50:15.717 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/5.MinOverlap 2024-09-16T07:50:15.717 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ZeroOverlap 2024-09-16T07:50:15.782 INFO:tasks.workunit.client.0.smithi151.stdout:seed 31647 2024-09-16T07:50:15.782 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = EncryptedFlattenTest/6.* 2024-09-16T07:50:15.782 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T07:50:15.782 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:50:15.782 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/6, where TypeParam = LUKS2UnderLUKS2 2024-09-16T07:50:15.882 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/6.Simple 2024-09-16T07:50:17.507 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T07:50:17.508 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:17.508 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Simple (1628 ms) 2024-09-16T07:50:17.508 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/6.Grow 2024-09-16T07:50:17.508 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T07:50:17.508 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:17.508 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Grow (0 ms) 2024-09-16T07:50:17.508 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/6.Shrink 2024-09-16T07:50:17.508 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T07:50:17.508 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:17.508 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Shrink (1 ms) 2024-09-16T07:50:17.508 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOne 2024-09-16T07:50:17.509 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T07:50:17.509 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:17.509 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOne (0 ms) 2024-09-16T07:50:17.509 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot 2024-09-16T07:50:17.509 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T07:50:17.509 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:17.509 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T07:50:17.509 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/6.MinOverlap 2024-09-16T07:50:17.509 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T07:50:17.509 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:17.510 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/6.MinOverlap (0 ms) 2024-09-16T07:50:17.510 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/6.ZeroOverlap 2024-09-16T07:50:17.510 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T07:50:17.510 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:17.510 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ZeroOverlap (0 ms) 2024-09-16T07:50:18.511 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/6 (1629 ms total) 2024-09-16T07:50:18.511 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:50:18.511 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:50:18.511 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 7 tests from 1 test suite ran. (2729 ms total) 2024-09-16T07:50:18.511 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 0 tests. 2024-09-16T07:50:18.511 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T07:50:18.511 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Simple 2024-09-16T07:50:18.511 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Grow 2024-09-16T07:50:18.511 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Shrink 2024-09-16T07:50:18.512 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOne 2024-09-16T07:50:18.512 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot 2024-09-16T07:50:18.512 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/6.MinOverlap 2024-09-16T07:50:18.512 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ZeroOverlap 2024-09-16T07:50:18.600 INFO:tasks.workunit.client.0.smithi151.stdout:seed 31711 2024-09-16T07:50:18.601 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = EncryptedFlattenTest/7.* 2024-09-16T07:50:18.601 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T07:50:18.601 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:50:18.601 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/7, where TypeParam = LUKS2UnderLUKS1 2024-09-16T07:50:18.692 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/7.Simple 2024-09-16T07:50:20.513 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T07:50:20.513 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:20.513 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Simple (1820 ms) 2024-09-16T07:50:20.513 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/7.Grow 2024-09-16T07:50:20.513 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T07:50:20.513 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:20.513 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Grow (0 ms) 2024-09-16T07:50:20.513 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/7.Shrink 2024-09-16T07:50:20.513 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T07:50:20.513 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:20.514 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Shrink (0 ms) 2024-09-16T07:50:20.514 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOne 2024-09-16T07:50:20.514 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T07:50:20.514 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:20.514 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOne (0 ms) 2024-09-16T07:50:20.514 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot 2024-09-16T07:50:20.514 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T07:50:20.514 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:20.514 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T07:50:20.514 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/7.MinOverlap 2024-09-16T07:50:20.514 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T07:50:20.514 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:20.514 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/7.MinOverlap (0 ms) 2024-09-16T07:50:20.515 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] EncryptedFlattenTest/7.ZeroOverlap 2024-09-16T07:50:20.515 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T07:50:20.515 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:20.515 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ZeroOverlap (0 ms) 2024-09-16T07:50:21.520 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 7 tests from EncryptedFlattenTest/7 (1820 ms total) 2024-09-16T07:50:21.520 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:50:21.520 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:50:21.520 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 7 tests from 1 test suite ran. (2919 ms total) 2024-09-16T07:50:21.521 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 0 tests. 2024-09-16T07:50:21.521 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T07:50:21.521 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Simple 2024-09-16T07:50:21.521 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Grow 2024-09-16T07:50:21.521 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Shrink 2024-09-16T07:50:21.521 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOne 2024-09-16T07:50:21.521 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot 2024-09-16T07:50:21.521 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/7.MinOverlap 2024-09-16T07:50:21.521 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ZeroOverlap 2024-09-16T07:50:21.583 INFO:tasks.workunit.client.0.smithi151.stdout:seed 31775 2024-09-16T07:50:21.583 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = TestImageWatcher.* 2024-09-16T07:50:21.583 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-16T07:50:21.583 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:50:21.584 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 17 tests from TestImageWatcher 2024-09-16T07:50:23.526 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifyHeaderUpdate 2024-09-16T07:50:25.642 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:460: Skipped 2024-09-16T07:50:25.642 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:25.642 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyHeaderUpdate (2115 ms) 2024-09-16T07:50:25.642 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifyFlatten 2024-09-16T07:50:25.686 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:478: Skipped 2024-09-16T07:50:25.687 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:25.687 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyFlatten (45 ms) 2024-09-16T07:50:25.687 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifyResize 2024-09-16T07:50:25.732 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:512: Skipped 2024-09-16T07:50:25.733 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:25.733 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyResize (46 ms) 2024-09-16T07:50:25.733 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifyRebuildObjectMap 2024-09-16T07:50:25.779 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:546: Skipped 2024-09-16T07:50:25.779 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:25.779 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyRebuildObjectMap (46 ms) 2024-09-16T07:50:25.779 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifyUpdateFeatures 2024-09-16T07:50:25.827 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:581: Skipped 2024-09-16T07:50:25.828 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:25.828 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyUpdateFeatures (49 ms) 2024-09-16T07:50:25.828 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifySnapCreate 2024-09-16T07:50:25.876 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:611: Skipped 2024-09-16T07:50:25.876 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:25.876 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreate (49 ms) 2024-09-16T07:50:25.877 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifySnapCreateError 2024-09-16T07:50:25.926 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:646: Skipped 2024-09-16T07:50:25.926 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:25.926 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreateError (49 ms) 2024-09-16T07:50:25.926 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifySnapRename 2024-09-16T07:50:25.977 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:670: Skipped 2024-09-16T07:50:25.977 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:25.977 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRename (51 ms) 2024-09-16T07:50:25.977 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifySnapRenameError 2024-09-16T07:50:26.025 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:701: Skipped 2024-09-16T07:50:26.026 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:26.026 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRenameError (49 ms) 2024-09-16T07:50:26.026 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifySnapRemove 2024-09-16T07:50:26.077 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:723: Skipped 2024-09-16T07:50:26.077 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:26.077 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRemove (51 ms) 2024-09-16T07:50:26.077 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifySnapProtect 2024-09-16T07:50:26.129 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:754: Skipped 2024-09-16T07:50:26.129 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:26.129 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapProtect (53 ms) 2024-09-16T07:50:26.129 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifySnapUnprotect 2024-09-16T07:50:26.178 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:785: Skipped 2024-09-16T07:50:26.179 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:26.179 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapUnprotect (49 ms) 2024-09-16T07:50:26.179 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifyRename 2024-09-16T07:50:26.228 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:816: Skipped 2024-09-16T07:50:26.228 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:26.228 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyRename (49 ms) 2024-09-16T07:50:26.228 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifyAsyncTimedOut 2024-09-16T07:50:26.277 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:847: Skipped 2024-09-16T07:50:26.277 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:26.277 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncTimedOut (49 ms) 2024-09-16T07:50:26.277 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifyAsyncError 2024-09-16T07:50:26.326 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:867: Skipped 2024-09-16T07:50:26.326 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:26.326 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncError (50 ms) 2024-09-16T07:50:26.326 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifyAsyncCompleteError 2024-09-16T07:50:26.379 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:887: Skipped 2024-09-16T07:50:26.379 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:26.380 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncCompleteError (51 ms) 2024-09-16T07:50:26.380 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-09-16T07:50:26.429 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:918: Skipped 2024-09-16T07:50:26.429 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:26.429 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncRequestTimedOut (52 ms) 2024-09-16T07:50:26.541 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 17 tests from TestImageWatcher (2903 ms total) 2024-09-16T07:50:26.541 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:50:26.541 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:50:26.541 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 17 tests from 1 test suite ran. (4956 ms total) 2024-09-16T07:50:26.541 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 0 tests. 2024-09-16T07:50:26.541 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 17 tests, listed below: 2024-09-16T07:50:26.541 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyHeaderUpdate 2024-09-16T07:50:26.541 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyFlatten 2024-09-16T07:50:26.541 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyResize 2024-09-16T07:50:26.541 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyRebuildObjectMap 2024-09-16T07:50:26.541 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyUpdateFeatures 2024-09-16T07:50:26.541 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreate 2024-09-16T07:50:26.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreateError 2024-09-16T07:50:26.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRename 2024-09-16T07:50:26.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRenameError 2024-09-16T07:50:26.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRemove 2024-09-16T07:50:26.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapProtect 2024-09-16T07:50:26.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapUnprotect 2024-09-16T07:50:26.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyRename 2024-09-16T07:50:26.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncTimedOut 2024-09-16T07:50:26.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncError 2024-09-16T07:50:26.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncCompleteError 2024-09-16T07:50:26.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-09-16T07:50:26.620 INFO:tasks.workunit.client.0.smithi151.stdout:seed 31824 2024-09-16T07:50:26.621 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = TestInternal.* 2024-09-16T07:50:26.621 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 34 tests from 1 test suite. 2024-09-16T07:50:26.621 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:50:26.621 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 34 tests from TestInternal 2024-09-16T07:50:28.509 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.OpenByID 2024-09-16T07:50:30.663 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:176: Skipped 2024-09-16T07:50:30.663 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:30.663 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.OpenByID (2154 ms) 2024-09-16T07:50:30.663 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.OpenSnapDNE 2024-09-16T07:50:30.801 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestInternal.OpenSnapDNE (138 ms) 2024-09-16T07:50:30.802 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.IsExclusiveLockOwner 2024-09-16T07:50:30.861 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:198: Skipped 2024-09-16T07:50:30.862 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:30.862 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.IsExclusiveLockOwner (59 ms) 2024-09-16T07:50:30.862 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.ResizeLocksImage 2024-09-16T07:50:30.916 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:218: Skipped 2024-09-16T07:50:30.916 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:30.916 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.ResizeLocksImage (55 ms) 2024-09-16T07:50:30.916 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.ResizeFailsToLockImage 2024-09-16T07:50:30.964 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:232: Skipped 2024-09-16T07:50:30.965 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:30.965 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.ResizeFailsToLockImage (49 ms) 2024-09-16T07:50:30.965 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.SnapCreateLocksImage 2024-09-16T07:50:31.014 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:243: Skipped 2024-09-16T07:50:31.014 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:31.014 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapCreateLocksImage (50 ms) 2024-09-16T07:50:31.014 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.SnapCreateFailsToLockImage 2024-09-16T07:50:31.062 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:261: Skipped 2024-09-16T07:50:31.062 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:31.062 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapCreateFailsToLockImage (47 ms) 2024-09-16T07:50:31.062 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.SnapRollbackLocksImage 2024-09-16T07:50:31.116 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:271: Skipped 2024-09-16T07:50:31.116 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:31.116 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapRollbackLocksImage (55 ms) 2024-09-16T07:50:31.116 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.SnapRollbackFailsToLockImage 2024-09-16T07:50:31.164 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:289: Skipped 2024-09-16T07:50:31.164 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:31.164 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapRollbackFailsToLockImage (47 ms) 2024-09-16T07:50:31.164 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.SnapSetReleasesLock 2024-09-16T07:50:31.216 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:306: Skipped 2024-09-16T07:50:31.216 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:31.216 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapSetReleasesLock (52 ms) 2024-09-16T07:50:31.216 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.FlattenLocksImage 2024-09-16T07:50:31.268 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:321: Skipped 2024-09-16T07:50:31.268 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:31.268 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.FlattenLocksImage (52 ms) 2024-09-16T07:50:31.268 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.FlattenFailsToLockImage 2024-09-16T07:50:31.316 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:348: Skipped 2024-09-16T07:50:31.316 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:31.316 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.FlattenFailsToLockImage (49 ms) 2024-09-16T07:50:31.317 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-16T07:50:31.367 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:382: Skipped 2024-09-16T07:50:31.367 INFO:tasks.workunit.client.0.smithi151.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:50:31.367 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted (50 ms) 2024-09-16T07:50:31.367 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-16T07:50:31.421 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:416: Skipped 2024-09-16T07:50:31.421 INFO:tasks.workunit.client.0.smithi151.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:50:31.421 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch (54 ms) 2024-09-16T07:50:31.421 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.AioWriteRequestsLock 2024-09-16T07:50:31.472 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:455: Skipped 2024-09-16T07:50:31.472 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:31.472 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.AioWriteRequestsLock (51 ms) 2024-09-16T07:50:31.472 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.AioDiscardRequestsLock 2024-09-16T07:50:31.520 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:481: Skipped 2024-09-16T07:50:31.520 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:31.520 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.AioDiscardRequestsLock (48 ms) 2024-09-16T07:50:31.520 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.CancelAsyncResize 2024-09-16T07:50:31.574 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:503: Skipped 2024-09-16T07:50:31.574 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:31.574 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.CancelAsyncResize (54 ms) 2024-09-16T07:50:31.574 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.MultipleResize 2024-09-16T07:50:32.057 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestInternal.MultipleResize (484 ms) 2024-09-16T07:50:32.057 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.Metadata 2024-09-16T07:50:32.106 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:592: Skipped 2024-09-16T07:50:32.106 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:32.106 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.Metadata (48 ms) 2024-09-16T07:50:32.106 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.MetadataConfApply 2024-09-16T07:50:32.154 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:639: Skipped 2024-09-16T07:50:32.154 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:32.154 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.MetadataConfApply (49 ms) 2024-09-16T07:50:32.155 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.SnapshotCopyup 2024-09-16T07:50:32.205 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:662: Skipped 2024-09-16T07:50:32.206 INFO:tasks.workunit.client.0.smithi151.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:50:32.206 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup (51 ms) 2024-09-16T07:50:32.206 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.SnapshotCopyupZeros 2024-09-16T07:50:32.256 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:814: Skipped 2024-09-16T07:50:32.256 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:32.256 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZeros (50 ms) 2024-09-16T07:50:32.256 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.SnapshotCopyupZerosMigration 2024-09-16T07:50:32.305 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:902: Skipped 2024-09-16T07:50:32.305 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:32.305 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZerosMigration (49 ms) 2024-09-16T07:50:32.305 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.ResizeCopyup 2024-09-16T07:50:32.354 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:987: Skipped 2024-09-16T07:50:32.355 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:32.355 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.ResizeCopyup (50 ms) 2024-09-16T07:50:32.355 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.DiscardCopyup 2024-09-16T07:50:32.403 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1052: Skipped 2024-09-16T07:50:32.403 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:32.403 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.DiscardCopyup (48 ms) 2024-09-16T07:50:32.403 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.ImageOptions 2024-09-16T07:50:32.457 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestInternal.ImageOptions (54 ms) 2024-09-16T07:50:32.457 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.WriteFullCopyup 2024-09-16T07:50:32.521 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1183: Skipped 2024-09-16T07:50:32.521 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:32.521 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.WriteFullCopyup (64 ms) 2024-09-16T07:50:32.521 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.DiffIterateCloneOverwrite 2024-09-16T07:50:32.613 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1257: Skipped 2024-09-16T07:50:32.614 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:32.614 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.DiffIterateCloneOverwrite (93 ms) 2024-09-16T07:50:32.614 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.TestCoR 2024-09-16T07:50:32.662 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1307: Skipped 2024-09-16T07:50:32.662 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:32.662 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.TestCoR (48 ms) 2024-09-16T07:50:32.662 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.FlattenNoEmptyObjects 2024-09-16T07:50:32.716 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1455: Skipped 2024-09-16T07:50:32.716 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:32.716 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.FlattenNoEmptyObjects (54 ms) 2024-09-16T07:50:32.716 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.PoolMetadataConfApply 2024-09-16T07:50:32.764 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1574: Skipped 2024-09-16T07:50:32.764 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:32.764 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.PoolMetadataConfApply (48 ms) 2024-09-16T07:50:32.764 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.Sparsify 2024-09-16T07:50:32.978 INFO:tasks.workunit.client.0.smithi151.stdout:sparsify_supported=1 2024-09-16T07:50:32.978 INFO:tasks.workunit.client.0.smithi151.stdout:sparse_read_supported=1 2024-09-16T07:50:33.330 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestInternal.Sparsify (566 ms) 2024-09-16T07:50:33.330 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.SparsifyClone 2024-09-16T07:50:33.381 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1737: Skipped 2024-09-16T07:50:33.381 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:33.381 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SparsifyClone (51 ms) 2024-09-16T07:50:33.381 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestInternal.MissingDataPool 2024-09-16T07:50:33.430 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1800: Skipped 2024-09-16T07:50:33.430 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:33.430 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.MissingDataPool (50 ms) 2024-09-16T07:50:33.569 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 34 tests from TestInternal (4921 ms total) 2024-09-16T07:50:33.570 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:50:33.570 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:50:33.570 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 34 tests from 1 test suite ran. (6949 ms total) 2024-09-16T07:50:33.570 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 4 tests. 2024-09-16T07:50:33.570 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 30 tests, listed below: 2024-09-16T07:50:33.570 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.OpenByID 2024-09-16T07:50:33.570 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.IsExclusiveLockOwner 2024-09-16T07:50:33.570 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.ResizeLocksImage 2024-09-16T07:50:33.570 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.ResizeFailsToLockImage 2024-09-16T07:50:33.570 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapCreateLocksImage 2024-09-16T07:50:33.570 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapCreateFailsToLockImage 2024-09-16T07:50:33.570 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapRollbackLocksImage 2024-09-16T07:50:33.571 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapRollbackFailsToLockImage 2024-09-16T07:50:33.571 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapSetReleasesLock 2024-09-16T07:50:33.571 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.FlattenLocksImage 2024-09-16T07:50:33.571 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.FlattenFailsToLockImage 2024-09-16T07:50:33.571 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-16T07:50:33.571 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-16T07:50:33.571 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.AioWriteRequestsLock 2024-09-16T07:50:33.571 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.AioDiscardRequestsLock 2024-09-16T07:50:33.571 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.CancelAsyncResize 2024-09-16T07:50:33.571 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.Metadata 2024-09-16T07:50:33.571 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.MetadataConfApply 2024-09-16T07:50:33.571 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup 2024-09-16T07:50:33.571 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZeros 2024-09-16T07:50:33.571 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZerosMigration 2024-09-16T07:50:33.571 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.ResizeCopyup 2024-09-16T07:50:33.572 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.DiscardCopyup 2024-09-16T07:50:33.572 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.WriteFullCopyup 2024-09-16T07:50:33.572 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.DiffIterateCloneOverwrite 2024-09-16T07:50:33.572 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.TestCoR 2024-09-16T07:50:33.572 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.FlattenNoEmptyObjects 2024-09-16T07:50:33.572 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.PoolMetadataConfApply 2024-09-16T07:50:33.572 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.SparsifyClone 2024-09-16T07:50:33.572 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestInternal.MissingDataPool 2024-09-16T07:50:33.636 INFO:tasks.workunit.client.0.smithi151.stdout:seed 31876 2024-09-16T07:50:33.636 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = TestMirroring.* 2024-09-16T07:50:33.636 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 51 tests from 1 test suite. 2024-09-16T07:50:33.637 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:50:33.637 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 51 tests from TestMirroring 2024-09-16T07:50:35.579 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage 2024-09-16T07:50:39.198 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage (3619 ms) 2024-09-16T07:50:39.199 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool 2024-09-16T07:50:40.949 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool (1751 ms) 2024-09-16T07:50:40.949 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled 2024-09-16T07:50:42.284 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled (1335 ms) 2024-09-16T07:50:42.285 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage 2024-09-16T07:50:44.096 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage (1812 ms) 2024-09-16T07:50:44.096 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap 2024-09-16T07:50:45.665 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap (1568 ms) 2024-09-16T07:50:45.665 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModePool 2024-09-16T07:50:47.300 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModePool (1635 ms) 2024-09-16T07:50:47.300 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled 2024-09-16T07:50:49.236 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled (1935 ms) 2024-09-16T07:50:49.236 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.DisableImageMirrorWithPeer 2024-09-16T07:50:49.236 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:482: Skipped 2024-09-16T07:50:49.236 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:49.236 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer (0 ms) 2024-09-16T07:50:49.236 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.DisableJournalingWithPeer 2024-09-16T07:50:49.237 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:520: Skipped 2024-09-16T07:50:49.237 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:49.237 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer (1 ms) 2024-09-16T07:50:49.237 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling 2024-09-16T07:50:50.383 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling (1147 ms) 2024-09-16T07:50:50.383 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling 2024-09-16T07:50:51.636 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling (1253 ms) 2024-09-16T07:50:51.636 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling 2024-09-16T07:50:54.244 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling (2608 ms) 2024-09-16T07:50:54.244 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock 2024-09-16T07:50:56.122 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock (1878 ms) 2024-09-16T07:50:56.122 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeDisabled 2024-09-16T07:50:57.557 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeDisabled (1436 ms) 2024-09-16T07:50:57.558 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage 2024-09-16T07:50:59.070 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage (1513 ms) 2024-09-16T07:50:59.070 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool 2024-09-16T07:51:00.839 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool (1769 ms) 2024-09-16T07:51:00.840 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling 2024-09-16T07:51:02.156 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling (1317 ms) 2024-09-16T07:51:02.156 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling 2024-09-16T07:51:03.443 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling (1286 ms) 2024-09-16T07:51:03.443 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeDisabled 2024-09-16T07:51:04.999 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeDisabled (1557 ms) 2024-09-16T07:51:04.999 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage 2024-09-16T07:51:06.656 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage (1656 ms) 2024-09-16T07:51:06.656 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled 2024-09-16T07:51:10.448 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled (3792 ms) 2024-09-16T07:51:10.449 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModePool 2024-09-16T07:51:12.323 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModePool (1875 ms) 2024-09-16T07:51:12.323 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModePool 2024-09-16T07:51:14.021 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModePool (1698 ms) 2024-09-16T07:51:14.021 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModeImage 2024-09-16T07:51:15.663 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModeImage (1642 ms) 2024-09-16T07:51:15.663 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode 2024-09-16T07:51:18.223 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode (2561 ms) 2024-09-16T07:51:18.224 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode 2024-09-16T07:51:20.763 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode (2539 ms) 2024-09-16T07:51:20.763 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode 2024-09-16T07:51:22.972 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode (2209 ms) 2024-09-16T07:51:22.972 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode 2024-09-16T07:51:25.429 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode (2457 ms) 2024-09-16T07:51:25.429 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode 2024-09-16T07:51:27.903 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode (2475 ms) 2024-09-16T07:51:27.903 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode 2024-09-16T07:51:30.667 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode (2764 ms) 2024-09-16T07:51:30.667 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageEnabled 2024-09-16T07:51:32.115 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageEnabled (1448 ms) 2024-09-16T07:51:32.115 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDisabled 2024-09-16T07:51:33.436 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDisabled (1320 ms) 2024-09-16T07:51:33.436 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.RemoveImage_With_ImageWithoutJournal 2024-09-16T07:51:34.465 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.RemoveImage_With_ImageWithoutJournal (1029 ms) 2024-09-16T07:51:34.465 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDemoted 2024-09-16T07:51:36.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDemoted (2077 ms) 2024-09-16T07:51:36.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.TrashMoveRestore_PoolMode 2024-09-16T07:51:38.574 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.TrashMoveRestore_PoolMode (2033 ms) 2024-09-16T07:51:38.575 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled 2024-09-16T07:51:40.294 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled (1719 ms) 2024-09-16T07:51:40.294 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled 2024-09-16T07:51:42.177 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled (1884 ms) 2024-09-16T07:51:42.177 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.MirrorStatusList 2024-09-16T07:51:43.431 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.MirrorStatusList (1253 ms) 2024-09-16T07:51:43.431 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.RemoveBootstrapped 2024-09-16T07:51:45.010 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.RemoveBootstrapped (1579 ms) 2024-09-16T07:51:45.010 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.AioPromoteDemote 2024-09-16T07:51:52.848 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.AioPromoteDemote (7839 ms) 2024-09-16T07:51:52.848 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.AioGetInfo 2024-09-16T07:51:58.652 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.AioGetInfo (5804 ms) 2024-09-16T07:51:58.653 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.AioGetStatus 2024-09-16T07:52:02.397 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.AioGetStatus (3745 ms) 2024-09-16T07:52:02.397 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.SiteName 2024-09-16T07:52:02.403 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.SiteName (6 ms) 2024-09-16T07:52:02.403 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.Bootstrap 2024-09-16T07:52:17.929 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.Bootstrap (15525 ms) 2024-09-16T07:52:17.929 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.PeerDirection 2024-09-16T07:52:18.028 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroring.PeerDirection (99 ms) 2024-09-16T07:52:18.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.Snapshot 2024-09-16T07:52:18.029 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1109: Skipped 2024-09-16T07:52:18.029 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:18.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.Snapshot (0 ms) 2024-09-16T07:52:18.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.SnapshotRemoveOnDisable 2024-09-16T07:52:18.029 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1188: Skipped 2024-09-16T07:52:18.029 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:18.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.SnapshotRemoveOnDisable (0 ms) 2024-09-16T07:52:18.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.SnapshotUnlinkPeer 2024-09-16T07:52:18.029 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1226: Skipped 2024-09-16T07:52:18.029 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:18.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.SnapshotUnlinkPeer (0 ms) 2024-09-16T07:52:18.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.SnapshotImageState 2024-09-16T07:52:18.030 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1339: Skipped 2024-09-16T07:52:18.030 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:18.030 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.SnapshotImageState (0 ms) 2024-09-16T07:52:18.030 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.SnapshotPromoteDemote 2024-09-16T07:52:18.030 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1449: Skipped 2024-09-16T07:52:18.030 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:18.030 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.SnapshotPromoteDemote (0 ms) 2024-09-16T07:52:18.030 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroring.AioSnapshotCreate 2024-09-16T07:52:18.030 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1484: Skipped 2024-09-16T07:52:18.030 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:18.030 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.AioSnapshotCreate (0 ms) 2024-09-16T07:52:19.013 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 51 tests from TestMirroring (102448 ms total) 2024-09-16T07:52:19.014 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:52:19.014 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:52:19.014 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 51 tests from 1 test suite ran. (105377 ms total) 2024-09-16T07:52:19.014 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 43 tests. 2024-09-16T07:52:19.014 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-16T07:52:19.014 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer 2024-09-16T07:52:19.014 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer 2024-09-16T07:52:19.014 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.Snapshot 2024-09-16T07:52:19.014 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.SnapshotRemoveOnDisable 2024-09-16T07:52:19.014 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.SnapshotUnlinkPeer 2024-09-16T07:52:19.014 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.SnapshotImageState 2024-09-16T07:52:19.015 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.SnapshotPromoteDemote 2024-09-16T07:52:19.015 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestMirroring.AioSnapshotCreate 2024-09-16T07:52:19.127 INFO:tasks.workunit.client.0.smithi151.stdout:seed 32380 2024-09-16T07:52:19.128 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = TestGroup.* 2024-09-16T07:52:19.128 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-16T07:52:19.128 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:52:19.128 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 13 tests from TestGroup 2024-09-16T07:52:21.012 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestGroup.group_create 2024-09-16T07:52:23.228 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestGroup.group_create (2216 ms) 2024-09-16T07:52:23.228 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestGroup.group_createPP 2024-09-16T07:52:23.421 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestGroup.group_createPP (192 ms) 2024-09-16T07:52:23.421 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestGroup.group_get_id 2024-09-16T07:52:23.570 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestGroup.group_get_id (150 ms) 2024-09-16T07:52:23.570 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestGroup.group_get_idPP 2024-09-16T07:52:23.721 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestGroup.group_get_idPP (151 ms) 2024-09-16T07:52:23.721 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestGroup.add_image 2024-09-16T07:52:23.772 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:113: Skipped 2024-09-16T07:52:23.772 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:23.772 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.add_image (50 ms) 2024-09-16T07:52:23.772 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestGroup.add_imagePP 2024-09-16T07:52:23.820 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:195: Skipped 2024-09-16T07:52:23.820 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:23.820 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.add_imagePP (48 ms) 2024-09-16T07:52:23.820 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestGroup.add_snapshot 2024-09-16T07:52:23.869 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:260: Skipped 2024-09-16T07:52:23.869 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:23.869 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.add_snapshot (49 ms) 2024-09-16T07:52:23.869 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestGroup.add_snapshotPP 2024-09-16T07:52:23.917 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:413: Skipped 2024-09-16T07:52:23.917 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:23.917 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.add_snapshotPP (48 ms) 2024-09-16T07:52:23.917 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestGroup.snap_get_info 2024-09-16T07:52:23.977 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:498: Skipped 2024-09-16T07:52:23.977 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:23.977 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.snap_get_info (61 ms) 2024-09-16T07:52:23.977 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestGroup.snap_get_infoPP 2024-09-16T07:52:24.027 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:553: Skipped 2024-09-16T07:52:24.027 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:24.027 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.snap_get_infoPP (50 ms) 2024-09-16T07:52:24.028 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestGroup.snap_list2 2024-09-16T07:52:24.077 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:601: Skipped 2024-09-16T07:52:24.077 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:24.077 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.snap_list2 (50 ms) 2024-09-16T07:52:24.077 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestGroup.snap_list2PP 2024-09-16T07:52:24.127 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:700: Skipped 2024-09-16T07:52:24.128 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:24.128 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.snap_list2PP (50 ms) 2024-09-16T07:52:24.128 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestGroup.snap_list_internal 2024-09-16T07:52:24.175 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:781: Skipped 2024-09-16T07:52:24.176 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:24.176 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.snap_list_internal (48 ms) 2024-09-16T07:52:25.028 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 13 tests from TestGroup (3163 ms total) 2024-09-16T07:52:25.028 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:52:25.028 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:52:25.028 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 13 tests from 1 test suite ran. (5900 ms total) 2024-09-16T07:52:25.028 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 4 tests. 2024-09-16T07:52:25.028 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 9 tests, listed below: 2024-09-16T07:52:25.028 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.add_image 2024-09-16T07:52:25.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.add_imagePP 2024-09-16T07:52:25.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.add_snapshot 2024-09-16T07:52:25.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.add_snapshotPP 2024-09-16T07:52:25.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.snap_get_info 2024-09-16T07:52:25.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.snap_get_infoPP 2024-09-16T07:52:25.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.snap_list2 2024-09-16T07:52:25.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.snap_list2PP 2024-09-16T07:52:25.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestGroup.snap_list_internal 2024-09-16T07:52:25.094 INFO:tasks.workunit.client.0.smithi151.stdout:seed 32429 2024-09-16T07:52:25.094 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = TestMirroringWatcher.* 2024-09-16T07:52:25.094 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-16T07:52:25.094 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:52:25.095 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 2 tests from TestMirroringWatcher 2024-09-16T07:52:27.034 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroringWatcher.ModeUpdated 2024-09-16T07:52:29.268 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroringWatcher.ModeUpdated (2234 ms) 2024-09-16T07:52:29.268 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestMirroringWatcher.ImageStatusUpdated 2024-09-16T07:52:29.417 INFO:tasks.workunit.client.0.smithi151.stdout:[ OK ] TestMirroringWatcher.ImageStatusUpdated (149 ms) 2024-09-16T07:52:30.055 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 2 tests from TestMirroringWatcher (2383 ms total) 2024-09-16T07:52:30.055 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:52:30.055 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:52:30.055 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 2 tests from 1 test suite ran. (4960 ms total) 2024-09-16T07:52:30.055 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 2 tests. 2024-09-16T07:52:30.133 INFO:tasks.workunit.client.0.smithi151.stdout:seed 32481 2024-09-16T07:52:30.134 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = TestObjectMap.* 2024-09-16T07:52:30.134 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T07:52:30.134 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:52:30.135 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 4 tests from TestObjectMap 2024-09-16T07:52:32.061 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-09-16T07:52:34.656 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:38: Skipped 2024-09-16T07:52:34.656 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:34.656 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenCorrupt (2595 ms) 2024-09-16T07:52:34.656 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-09-16T07:52:34.705 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:66: Skipped 2024-09-16T07:52:34.705 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:34.705 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenTooSmall (50 ms) 2024-09-16T07:52:34.705 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestObjectMap.InvalidateFlagOnDisk 2024-09-16T07:52:34.753 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:95: Skipped 2024-09-16T07:52:34.753 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:34.753 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestObjectMap.InvalidateFlagOnDisk (47 ms) 2024-09-16T07:52:34.753 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-09-16T07:52:34.804 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:128: Skipped 2024-09-16T07:52:34.804 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:34.804 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall (52 ms) 2024-09-16T07:52:35.541 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 4 tests from TestObjectMap (2744 ms total) 2024-09-16T07:52:35.542 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:52:35.542 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:52:35.542 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 4 tests from 1 test suite ran. (5407 ms total) 2024-09-16T07:52:35.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 0 tests. 2024-09-16T07:52:35.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-16T07:52:35.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-09-16T07:52:35.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-09-16T07:52:35.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestObjectMap.InvalidateFlagOnDisk 2024-09-16T07:52:35.542 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-09-16T07:52:35.542 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:52:35.542 INFO:tasks.workunit.client.0.smithi151.stdout: YOU HAVE 1 DISABLED TEST 2024-09-16T07:52:35.542 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:52:35.604 INFO:tasks.workunit.client.0.smithi151.stdout:seed 32530 2024-09-16T07:52:35.604 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = TestOperations.* 2024-09-16T07:52:35.605 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 1 test from 1 test suite. 2024-09-16T07:52:35.605 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:52:35.605 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 1 test from TestOperations 2024-09-16T07:52:37.550 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestOperations.DisableJournalingCorrupt 2024-09-16T07:52:39.670 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Operations.cc:18: Skipped 2024-09-16T07:52:39.670 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:39.670 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt (2120 ms) 2024-09-16T07:52:40.565 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 1 test from TestOperations (2120 ms total) 2024-09-16T07:52:40.565 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:52:40.565 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:52:40.566 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 1 test from 1 test suite ran. (4961 ms total) 2024-09-16T07:52:40.566 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 0 tests. 2024-09-16T07:52:40.566 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-16T07:52:40.566 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt 2024-09-16T07:52:40.633 INFO:tasks.workunit.client.0.smithi151.stdout:seed 32579 2024-09-16T07:52:40.633 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = TestTrash.* 2024-09-16T07:52:40.634 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-16T07:52:40.634 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:52:40.634 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 2 tests from TestTrash 2024-09-16T07:52:42.527 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestTrash.UserRemovingSource 2024-09-16T07:52:44.685 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Trash.cc:36: Skipped 2024-09-16T07:52:44.685 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:44.685 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestTrash.UserRemovingSource (2157 ms) 2024-09-16T07:52:44.685 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestTrash.RestoreMirroringSource 2024-09-16T07:52:44.745 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Trash.cc:93: Skipped 2024-09-16T07:52:44.746 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:44.746 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestTrash.RestoreMirroringSource (61 ms) 2024-09-16T07:52:45.592 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 2 tests from TestTrash (2218 ms total) 2024-09-16T07:52:45.592 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:52:45.592 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:52:45.592 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 2 tests from 1 test suite ran. (4958 ms total) 2024-09-16T07:52:45.592 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 0 tests. 2024-09-16T07:52:45.592 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-16T07:52:45.592 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestTrash.UserRemovingSource 2024-09-16T07:52:45.592 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestTrash.RestoreMirroringSource 2024-09-16T07:52:45.664 INFO:tasks.workunit.client.0.smithi151.stdout:seed 32628 2024-09-16T07:52:45.664 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = TestJournalEntries.* 2024-09-16T07:52:45.665 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T07:52:45.665 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:52:45.665 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 4 tests from TestJournalEntries 2024-09-16T07:52:47.603 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalEntries.AioWrite 2024-09-16T07:52:49.706 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:118: Skipped 2024-09-16T07:52:49.706 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:49.706 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalEntries.AioWrite (2103 ms) 2024-09-16T07:52:49.706 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalEntries.AioDiscard 2024-09-16T07:52:49.751 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:163: Skipped 2024-09-16T07:52:49.752 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:49.752 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard (46 ms) 2024-09-16T07:52:49.752 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalEntries.AioDiscardWithPrune 2024-09-16T07:52:49.809 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:200: Skipped 2024-09-16T07:52:49.809 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:49.809 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune (57 ms) 2024-09-16T07:52:49.809 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalEntries.AioFlush 2024-09-16T07:52:49.856 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:263: Skipped 2024-09-16T07:52:49.857 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:49.857 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalEntries.AioFlush (48 ms) 2024-09-16T07:52:50.618 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 4 tests from TestJournalEntries (2254 ms total) 2024-09-16T07:52:50.618 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:52:50.618 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:52:50.618 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 4 tests from 1 test suite ran. (4954 ms total) 2024-09-16T07:52:50.618 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 0 tests. 2024-09-16T07:52:50.619 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-16T07:52:50.619 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalEntries.AioWrite 2024-09-16T07:52:50.619 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard 2024-09-16T07:52:50.619 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune 2024-09-16T07:52:50.619 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalEntries.AioFlush 2024-09-16T07:52:50.693 INFO:tasks.workunit.client.0.smithi151.stdout:seed 32677 2024-09-16T07:52:50.694 INFO:tasks.workunit.client.0.smithi151.stdout:Note: Google Test filter = TestJournalReplay.* 2024-09-16T07:52:50.694 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] Running 16 tests from 1 test suite. 2024-09-16T07:52:50.694 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment set-up. 2024-09-16T07:52:50.694 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 16 tests from TestJournalReplay 2024-09-16T07:52:52.529 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.AioDiscardEvent 2024-09-16T07:52:54.736 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:109: Skipped 2024-09-16T07:52:54.737 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:54.737 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent (2207 ms) 2024-09-16T07:52:54.737 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.AioWriteEvent 2024-09-16T07:52:54.784 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:200: Skipped 2024-09-16T07:52:54.784 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:54.784 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent (47 ms) 2024-09-16T07:52:54.784 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.AioFlushEvent 2024-09-16T07:52:54.837 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:261: Skipped 2024-09-16T07:52:54.837 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:54.837 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent (54 ms) 2024-09-16T07:52:54.837 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.SnapCreate 2024-09-16T07:52:54.888 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:307: Skipped 2024-09-16T07:52:54.888 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:54.888 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate (50 ms) 2024-09-16T07:52:54.888 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.SnapProtect 2024-09-16T07:52:54.935 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:348: Skipped 2024-09-16T07:52:54.935 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:54.935 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect (47 ms) 2024-09-16T07:52:54.935 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.SnapUnprotect 2024-09-16T07:52:54.981 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:394: Skipped 2024-09-16T07:52:54.981 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:54.981 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect (47 ms) 2024-09-16T07:52:54.981 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.SnapRename 2024-09-16T07:52:55.028 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:450: Skipped 2024-09-16T07:52:55.029 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:55.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.SnapRename (47 ms) 2024-09-16T07:52:55.029 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.SnapRollback 2024-09-16T07:52:55.078 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:500: Skipped 2024-09-16T07:52:55.078 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:55.078 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback (49 ms) 2024-09-16T07:52:55.078 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.SnapRemove 2024-09-16T07:52:55.125 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:541: Skipped 2024-09-16T07:52:55.126 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:55.126 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove (48 ms) 2024-09-16T07:52:55.126 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.Rename 2024-09-16T07:52:55.186 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:590: Skipped 2024-09-16T07:52:55.186 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:55.187 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.Rename (61 ms) 2024-09-16T07:52:55.187 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.Resize 2024-09-16T07:52:55.238 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:624: Skipped 2024-09-16T07:52:55.238 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:55.238 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.Resize (51 ms) 2024-09-16T07:52:55.238 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.Flatten 2024-09-16T07:52:55.286 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:657: Skipped 2024-09-16T07:52:55.286 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:55.286 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.Flatten (49 ms) 2024-09-16T07:52:55.287 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.UpdateFeatures 2024-09-16T07:52:55.332 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:704: Skipped 2024-09-16T07:52:55.332 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:55.332 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures (46 ms) 2024-09-16T07:52:55.333 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.MetadataSet 2024-09-16T07:52:55.379 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:741: Skipped 2024-09-16T07:52:55.379 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:55.379 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet (47 ms) 2024-09-16T07:52:55.380 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.MetadataRemove 2024-09-16T07:52:55.428 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:781: Skipped 2024-09-16T07:52:55.428 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:55.428 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove (48 ms) 2024-09-16T07:52:55.428 INFO:tasks.workunit.client.0.smithi151.stdout:[ RUN ] TestJournalReplay.ObjectPosition 2024-09-16T07:52:55.477 INFO:tasks.workunit.client.0.smithi151.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:824: Skipped 2024-09-16T07:52:55.477 INFO:tasks.workunit.client.0.smithi151.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:52:55.478 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition (50 ms) 2024-09-16T07:52:55.635 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] 16 tests from TestJournalReplay (2948 ms total) 2024-09-16T07:52:55.636 INFO:tasks.workunit.client.0.smithi151.stdout: 2024-09-16T07:52:55.636 INFO:tasks.workunit.client.0.smithi151.stdout:[----------] Global test environment tear-down 2024-09-16T07:52:55.636 INFO:tasks.workunit.client.0.smithi151.stdout:[==========] 16 tests from 1 test suite ran. (4941 ms total) 2024-09-16T07:52:55.636 INFO:tasks.workunit.client.0.smithi151.stdout:[ PASSED ] 0 tests. 2024-09-16T07:52:55.636 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-16T07:52:55.636 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent 2024-09-16T07:52:55.636 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent 2024-09-16T07:52:55.636 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent 2024-09-16T07:52:55.636 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate 2024-09-16T07:52:55.636 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect 2024-09-16T07:52:55.636 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect 2024-09-16T07:52:55.636 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.SnapRename 2024-09-16T07:52:55.637 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback 2024-09-16T07:52:55.637 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove 2024-09-16T07:52:55.637 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.Rename 2024-09-16T07:52:55.637 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.Resize 2024-09-16T07:52:55.637 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.Flatten 2024-09-16T07:52:55.637 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures 2024-09-16T07:52:55.637 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet 2024-09-16T07:52:55.637 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove 2024-09-16T07:52:55.637 INFO:tasks.workunit.client.0.smithi151.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition 2024-09-16T07:52:55.643 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T07:52:55.643 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T07:52:55.673 INFO:tasks.workunit:Stopping ['rbd/crimson/test_crimson_librbd.sh'] on client.0... 2024-09-16T07:52:55.674 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T07:52:56.119 DEBUG:teuthology.parallel:result is None 2024-09-16T07:52:56.120 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T07:52:56.150 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T07:52:56.150 DEBUG:teuthology.orchestra.run.smithi151:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T07:52:56.238 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T07:52:56.238 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T07:52:56.250 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:52:56.250 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:56.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:56.364+0000 7f8099d48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:56.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:56.373+0000 7f8099d48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:56.558 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:52:56.558 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2024-09-16T07:52:56.571 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":621,"stamp":"2024-09-16T07:52:55.632291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":11860,"kb_used_data":11860,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156881324,"statfs":{"total":160658620416,"available":160646475776,"internally_reserved":0,"allocated":12144640,"data_stored":12144640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.012682"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.629557+0000","last_change":"2024-09-16T07:38:55.253872+0000","last_active":"2024-09-16T07:52:48.629557+0000","last_peered":"2024-09-16T07:52:48.629557+0000","last_clean":"2024-09-16T07:52:48.629557+0000","last_became_active":"2024-09-16T07:38:53.368303+0000","last_became_peered":"2024-09-16T07:38:53.368303+0000","last_unstale":"2024-09-16T07:52:48.629557+0000","last_undegraded":"2024-09-16T07:52:48.629557+0000","last_fullsized":"2024-09-16T07:52:48.629557+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.635109+0000","last_change":"2024-09-16T07:38:55.258470+0000","last_active":"2024-09-16T07:52:48.635109+0000","last_peered":"2024-09-16T07:52:48.635109+0000","last_clean":"2024-09-16T07:52:48.635109+0000","last_became_active":"2024-09-16T07:38:53.421597+0000","last_became_peered":"2024-09-16T07:38:53.421597+0000","last_unstale":"2024-09-16T07:52:48.635109+0000","last_undegraded":"2024-09-16T07:52:48.635109+0000","last_fullsized":"2024-09-16T07:52:48.635109+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.633571+0000","last_change":"2024-09-16T07:38:55.254755+0000","last_active":"2024-09-16T07:52:48.633571+0000","last_peered":"2024-09-16T07:52:48.633571+0000","last_clean":"2024-09-16T07:52:48.633571+0000","last_became_active":"2024-09-16T07:38:53.390728+0000","last_became_peered":"2024-09-16T07:38:53.390728+0000","last_unstale":"2024-09-16T07:52:48.633571+0000","last_undegraded":"2024-09-16T07:52:48.633571+0000","last_fullsized":"2024-09-16T07:52:48.633571+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.626083+0000","last_change":"2024-09-16T07:38:55.254425+0000","last_active":"2024-09-16T07:52:48.626083+0000","last_peered":"2024-09-16T07:52:48.626083+0000","last_clean":"2024-09-16T07:52:48.626083+0000","last_became_active":"2024-09-16T07:38:53.383421+0000","last_became_peered":"2024-09-16T07:38:53.383421+0000","last_unstale":"2024-09-16T07:52:48.626083+0000","last_undegraded":"2024-09-16T07:52:48.626083+0000","last_fullsized":"2024-09-16T07:52:48.626083+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":569,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.649234+0000","last_change":"2024-09-16T07:38:55.254427+0000","last_active":"2024-09-16T07:52:49.649234+0000","last_peered":"2024-09-16T07:52:49.649234+0000","last_clean":"2024-09-16T07:52:49.649234+0000","last_became_active":"2024-09-16T07:38:53.455109+0000","last_became_peered":"2024-09-16T07:38:53.455109+0000","last_unstale":"2024-09-16T07:52:49.649234+0000","last_undegraded":"2024-09-16T07:52:49.649234+0000","last_fullsized":"2024-09-16T07:52:49.649234+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":567,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.647765+0000","last_change":"2024-09-16T07:38:55.257328+0000","last_active":"2024-09-16T07:52:49.647765+0000","last_peered":"2024-09-16T07:52:49.647765+0000","last_clean":"2024-09-16T07:52:49.647765+0000","last_became_active":"2024-09-16T07:38:53.437900+0000","last_became_peered":"2024-09-16T07:38:53.437900+0000","last_unstale":"2024-09-16T07:52:49.647765+0000","last_undegraded":"2024-09-16T07:52:49.647765+0000","last_fullsized":"2024-09-16T07:52:49.647765+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":567,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.647027+0000","last_change":"2024-09-16T07:38:55.250937+0000","last_active":"2024-09-16T07:52:49.647027+0000","last_peered":"2024-09-16T07:52:49.647027+0000","last_clean":"2024-09-16T07:52:49.647027+0000","last_became_active":"2024-09-16T07:38:53.392759+0000","last_became_peered":"2024-09-16T07:38:53.392759+0000","last_unstale":"2024-09-16T07:52:49.647027+0000","last_undegraded":"2024-09-16T07:52:49.647027+0000","last_fullsized":"2024-09-16T07:52:49.647027+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":565,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.635722+0000","last_change":"2024-09-16T07:38:55.258108+0000","last_active":"2024-09-16T07:52:48.635722+0000","last_peered":"2024-09-16T07:52:48.635722+0000","last_clean":"2024-09-16T07:52:48.635722+0000","last_became_active":"2024-09-16T07:38:53.396984+0000","last_became_peered":"2024-09-16T07:38:53.396984+0000","last_unstale":"2024-09-16T07:52:48.635722+0000","last_undegraded":"2024-09-16T07:52:48.635722+0000","last_fullsized":"2024-09-16T07:52:48.635722+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":633,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.630253+0000","last_change":"2024-09-16T07:38:52.292504+0000","last_active":"2024-09-16T07:52:48.630253+0000","last_peered":"2024-09-16T07:52:48.630253+0000","last_clean":"2024-09-16T07:52:48.630253+0000","last_became_active":"2024-09-16T07:38:52.263855+0000","last_became_peered":"2024-09-16T07:38:52.263855+0000","last_unstale":"2024-09-16T07:52:48.630253+0000","last_undegraded":"2024-09-16T07:52:48.630253+0000","last_fullsized":"2024-09-16T07:52:48.630253+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:51.189171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:51.189171+0000","last_clean_scrub_stamp":"2024-09-16T07:38:51.189171+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160646406144,"internally_reserved":0,"allocated":12214272,"data_stored":12214272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3348,"kb_used_data":3348,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294380,"statfs":{"total":53552873472,"available":53549445120,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739206,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4436,"kb_used_data":4436,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293292,"statfs":{"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4076,"kb_used_data":4076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293652,"statfs":{"total":53552873472,"available":53548699648,"internally_reserved":0,"allocated":4173824,"data_stored":4173824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53548699648,"internally_reserved":0,"allocated":4173824,"data_stored":4173824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53549375488,"internally_reserved":0,"allocated":3497984,"data_stored":3497984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:56.572 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:56.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:56.676+0000 7ff57ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:56.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:56.683+0000 7ff57ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:56.866 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:52:56.866 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2024-09-16T07:52:56.879 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":621,"stamp":"2024-09-16T07:52:55.632291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":11860,"kb_used_data":11860,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156881324,"statfs":{"total":160658620416,"available":160646475776,"internally_reserved":0,"allocated":12144640,"data_stored":12144640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.012682"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.629557+0000","last_change":"2024-09-16T07:38:55.253872+0000","last_active":"2024-09-16T07:52:48.629557+0000","last_peered":"2024-09-16T07:52:48.629557+0000","last_clean":"2024-09-16T07:52:48.629557+0000","last_became_active":"2024-09-16T07:38:53.368303+0000","last_became_peered":"2024-09-16T07:38:53.368303+0000","last_unstale":"2024-09-16T07:52:48.629557+0000","last_undegraded":"2024-09-16T07:52:48.629557+0000","last_fullsized":"2024-09-16T07:52:48.629557+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.635109+0000","last_change":"2024-09-16T07:38:55.258470+0000","last_active":"2024-09-16T07:52:48.635109+0000","last_peered":"2024-09-16T07:52:48.635109+0000","last_clean":"2024-09-16T07:52:48.635109+0000","last_became_active":"2024-09-16T07:38:53.421597+0000","last_became_peered":"2024-09-16T07:38:53.421597+0000","last_unstale":"2024-09-16T07:52:48.635109+0000","last_undegraded":"2024-09-16T07:52:48.635109+0000","last_fullsized":"2024-09-16T07:52:48.635109+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.633571+0000","last_change":"2024-09-16T07:38:55.254755+0000","last_active":"2024-09-16T07:52:48.633571+0000","last_peered":"2024-09-16T07:52:48.633571+0000","last_clean":"2024-09-16T07:52:48.633571+0000","last_became_active":"2024-09-16T07:38:53.390728+0000","last_became_peered":"2024-09-16T07:38:53.390728+0000","last_unstale":"2024-09-16T07:52:48.633571+0000","last_undegraded":"2024-09-16T07:52:48.633571+0000","last_fullsized":"2024-09-16T07:52:48.633571+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.626083+0000","last_change":"2024-09-16T07:38:55.254425+0000","last_active":"2024-09-16T07:52:48.626083+0000","last_peered":"2024-09-16T07:52:48.626083+0000","last_clean":"2024-09-16T07:52:48.626083+0000","last_became_active":"2024-09-16T07:38:53.383421+0000","last_became_peered":"2024-09-16T07:38:53.383421+0000","last_unstale":"2024-09-16T07:52:48.626083+0000","last_undegraded":"2024-09-16T07:52:48.626083+0000","last_fullsized":"2024-09-16T07:52:48.626083+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":569,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.649234+0000","last_change":"2024-09-16T07:38:55.254427+0000","last_active":"2024-09-16T07:52:49.649234+0000","last_peered":"2024-09-16T07:52:49.649234+0000","last_clean":"2024-09-16T07:52:49.649234+0000","last_became_active":"2024-09-16T07:38:53.455109+0000","last_became_peered":"2024-09-16T07:38:53.455109+0000","last_unstale":"2024-09-16T07:52:49.649234+0000","last_undegraded":"2024-09-16T07:52:49.649234+0000","last_fullsized":"2024-09-16T07:52:49.649234+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":567,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.647765+0000","last_change":"2024-09-16T07:38:55.257328+0000","last_active":"2024-09-16T07:52:49.647765+0000","last_peered":"2024-09-16T07:52:49.647765+0000","last_clean":"2024-09-16T07:52:49.647765+0000","last_became_active":"2024-09-16T07:38:53.437900+0000","last_became_peered":"2024-09-16T07:38:53.437900+0000","last_unstale":"2024-09-16T07:52:49.647765+0000","last_undegraded":"2024-09-16T07:52:49.647765+0000","last_fullsized":"2024-09-16T07:52:49.647765+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":567,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.647027+0000","last_change":"2024-09-16T07:38:55.250937+0000","last_active":"2024-09-16T07:52:49.647027+0000","last_peered":"2024-09-16T07:52:49.647027+0000","last_clean":"2024-09-16T07:52:49.647027+0000","last_became_active":"2024-09-16T07:38:53.392759+0000","last_became_peered":"2024-09-16T07:38:53.392759+0000","last_unstale":"2024-09-16T07:52:49.647027+0000","last_undegraded":"2024-09-16T07:52:49.647027+0000","last_fullsized":"2024-09-16T07:52:49.647027+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":565,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.635722+0000","last_change":"2024-09-16T07:38:55.258108+0000","last_active":"2024-09-16T07:52:48.635722+0000","last_peered":"2024-09-16T07:52:48.635722+0000","last_clean":"2024-09-16T07:52:48.635722+0000","last_became_active":"2024-09-16T07:38:53.396984+0000","last_became_peered":"2024-09-16T07:38:53.396984+0000","last_unstale":"2024-09-16T07:52:48.635722+0000","last_undegraded":"2024-09-16T07:52:48.635722+0000","last_fullsized":"2024-09-16T07:52:48.635722+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":633,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.630253+0000","last_change":"2024-09-16T07:38:52.292504+0000","last_active":"2024-09-16T07:52:48.630253+0000","last_peered":"2024-09-16T07:52:48.630253+0000","last_clean":"2024-09-16T07:52:48.630253+0000","last_became_active":"2024-09-16T07:38:52.263855+0000","last_became_peered":"2024-09-16T07:38:52.263855+0000","last_unstale":"2024-09-16T07:52:48.630253+0000","last_undegraded":"2024-09-16T07:52:48.630253+0000","last_fullsized":"2024-09-16T07:52:48.630253+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:51.189171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:51.189171+0000","last_clean_scrub_stamp":"2024-09-16T07:38:51.189171+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160646406144,"internally_reserved":0,"allocated":12214272,"data_stored":12214272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3348,"kb_used_data":3348,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294380,"statfs":{"total":53552873472,"available":53549445120,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739206,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4436,"kb_used_data":4436,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293292,"statfs":{"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4076,"kb_used_data":4076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293652,"statfs":{"total":53552873472,"available":53548699648,"internally_reserved":0,"allocated":4173824,"data_stored":4173824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53548699648,"internally_reserved":0,"allocated":4173824,"data_stored":4173824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53549375488,"internally_reserved":0,"allocated":3497984,"data_stored":3497984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:56.880 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:52:56.880 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:56.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:56.983+0000 7f2561f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:56.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:56.990+0000 7f2561f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:57.174 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:52:57.174 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2024-09-16T07:52:57.187 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":621,"stamp":"2024-09-16T07:52:55.632291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":11860,"kb_used_data":11860,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156881324,"statfs":{"total":160658620416,"available":160646475776,"internally_reserved":0,"allocated":12144640,"data_stored":12144640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.012682"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.629557+0000","last_change":"2024-09-16T07:38:55.253872+0000","last_active":"2024-09-16T07:52:48.629557+0000","last_peered":"2024-09-16T07:52:48.629557+0000","last_clean":"2024-09-16T07:52:48.629557+0000","last_became_active":"2024-09-16T07:38:53.368303+0000","last_became_peered":"2024-09-16T07:38:53.368303+0000","last_unstale":"2024-09-16T07:52:48.629557+0000","last_undegraded":"2024-09-16T07:52:48.629557+0000","last_fullsized":"2024-09-16T07:52:48.629557+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.635109+0000","last_change":"2024-09-16T07:38:55.258470+0000","last_active":"2024-09-16T07:52:48.635109+0000","last_peered":"2024-09-16T07:52:48.635109+0000","last_clean":"2024-09-16T07:52:48.635109+0000","last_became_active":"2024-09-16T07:38:53.421597+0000","last_became_peered":"2024-09-16T07:38:53.421597+0000","last_unstale":"2024-09-16T07:52:48.635109+0000","last_undegraded":"2024-09-16T07:52:48.635109+0000","last_fullsized":"2024-09-16T07:52:48.635109+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.633571+0000","last_change":"2024-09-16T07:38:55.254755+0000","last_active":"2024-09-16T07:52:48.633571+0000","last_peered":"2024-09-16T07:52:48.633571+0000","last_clean":"2024-09-16T07:52:48.633571+0000","last_became_active":"2024-09-16T07:38:53.390728+0000","last_became_peered":"2024-09-16T07:38:53.390728+0000","last_unstale":"2024-09-16T07:52:48.633571+0000","last_undegraded":"2024-09-16T07:52:48.633571+0000","last_fullsized":"2024-09-16T07:52:48.633571+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.626083+0000","last_change":"2024-09-16T07:38:55.254425+0000","last_active":"2024-09-16T07:52:48.626083+0000","last_peered":"2024-09-16T07:52:48.626083+0000","last_clean":"2024-09-16T07:52:48.626083+0000","last_became_active":"2024-09-16T07:38:53.383421+0000","last_became_peered":"2024-09-16T07:38:53.383421+0000","last_unstale":"2024-09-16T07:52:48.626083+0000","last_undegraded":"2024-09-16T07:52:48.626083+0000","last_fullsized":"2024-09-16T07:52:48.626083+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":569,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.649234+0000","last_change":"2024-09-16T07:38:55.254427+0000","last_active":"2024-09-16T07:52:49.649234+0000","last_peered":"2024-09-16T07:52:49.649234+0000","last_clean":"2024-09-16T07:52:49.649234+0000","last_became_active":"2024-09-16T07:38:53.455109+0000","last_became_peered":"2024-09-16T07:38:53.455109+0000","last_unstale":"2024-09-16T07:52:49.649234+0000","last_undegraded":"2024-09-16T07:52:49.649234+0000","last_fullsized":"2024-09-16T07:52:49.649234+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":567,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.647765+0000","last_change":"2024-09-16T07:38:55.257328+0000","last_active":"2024-09-16T07:52:49.647765+0000","last_peered":"2024-09-16T07:52:49.647765+0000","last_clean":"2024-09-16T07:52:49.647765+0000","last_became_active":"2024-09-16T07:38:53.437900+0000","last_became_peered":"2024-09-16T07:38:53.437900+0000","last_unstale":"2024-09-16T07:52:49.647765+0000","last_undegraded":"2024-09-16T07:52:49.647765+0000","last_fullsized":"2024-09-16T07:52:49.647765+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":567,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.647027+0000","last_change":"2024-09-16T07:38:55.250937+0000","last_active":"2024-09-16T07:52:49.647027+0000","last_peered":"2024-09-16T07:52:49.647027+0000","last_clean":"2024-09-16T07:52:49.647027+0000","last_became_active":"2024-09-16T07:38:53.392759+0000","last_became_peered":"2024-09-16T07:38:53.392759+0000","last_unstale":"2024-09-16T07:52:49.647027+0000","last_undegraded":"2024-09-16T07:52:49.647027+0000","last_fullsized":"2024-09-16T07:52:49.647027+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":565,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.635722+0000","last_change":"2024-09-16T07:38:55.258108+0000","last_active":"2024-09-16T07:52:48.635722+0000","last_peered":"2024-09-16T07:52:48.635722+0000","last_clean":"2024-09-16T07:52:48.635722+0000","last_became_active":"2024-09-16T07:38:53.396984+0000","last_became_peered":"2024-09-16T07:38:53.396984+0000","last_unstale":"2024-09-16T07:52:48.635722+0000","last_undegraded":"2024-09-16T07:52:48.635722+0000","last_fullsized":"2024-09-16T07:52:48.635722+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":633,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.630253+0000","last_change":"2024-09-16T07:38:52.292504+0000","last_active":"2024-09-16T07:52:48.630253+0000","last_peered":"2024-09-16T07:52:48.630253+0000","last_clean":"2024-09-16T07:52:48.630253+0000","last_became_active":"2024-09-16T07:38:52.263855+0000","last_became_peered":"2024-09-16T07:38:52.263855+0000","last_unstale":"2024-09-16T07:52:48.630253+0000","last_undegraded":"2024-09-16T07:52:48.630253+0000","last_fullsized":"2024-09-16T07:52:48.630253+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:51.189171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:51.189171+0000","last_clean_scrub_stamp":"2024-09-16T07:38:51.189171+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160646406144,"internally_reserved":0,"allocated":12214272,"data_stored":12214272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3348,"kb_used_data":3348,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294380,"statfs":{"total":53552873472,"available":53549445120,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739206,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4436,"kb_used_data":4436,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293292,"statfs":{"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4076,"kb_used_data":4076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293652,"statfs":{"total":53552873472,"available":53548699648,"internally_reserved":0,"allocated":4173824,"data_stored":4173824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53548699648,"internally_reserved":0,"allocated":4173824,"data_stored":4173824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53549375488,"internally_reserved":0,"allocated":3497984,"data_stored":3497984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:57.188 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:52:57.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:57.292+0000 7f9bdbed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:57.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:57.300+0000 7f9bdbed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:57.484 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:52:57.484 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":204,"fsid":"90090b2e-292a-455c-9d19-6e16a6c03bdd","created":"2024-09-16T07:38:42.421113+0000","modified":"2024-09-16T07:52:55.629234+0000","last_up_change":"2024-09-16T07:38:50.179518+0000","last_in_change":"2024-09-16T07:38:44.327285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:38:51.142237+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:38:52.193669+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b33fb345-52c6-41a7-a9b9-db9d9bcbd70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2678932617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6807","nonce":2678932617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2678932617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":2678932617}]},"public_addr":"172.21.15.151:6806/2678932617","cluster_addr":"172.21.15.151:6807/2678932617","heartbeat_back_addr":"172.21.15.151:6804/2678932617","heartbeat_front_addr":"172.21.15.151:6813/2678932617","state":["exists","up"]},{"osd":1,"uuid":"6d9c735b-5ce7-4289-9ed6-0ad7ab184314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2826126798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6803","nonce":2826126798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2826126798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":2826126798}]},"public_addr":"172.21.15.151:6802/2826126798","cluster_addr":"172.21.15.151:6803/2826126798","heartbeat_back_addr":"172.21.15.151:6808/2826126798","heartbeat_front_addr":"172.21.15.151:6805/2826126798","state":["exists","up"]},{"osd":2,"uuid":"2d9fa793-4b3d-4391-a6ca-db1612b967fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1756894788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1756894788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1756894788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1756894788}]},"public_addr":"172.21.15.151:6810/1756894788","cluster_addr":"172.21.15.151:6809/1756894788","heartbeat_back_addr":"172.21.15.151:6814/1756894788","heartbeat_front_addr":"172.21.15.151:6812/1756894788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":3,"snaps":[{"begin":2,"length":13},{"begin":17,"length":1},{"begin":21,"length":1},{"begin":24,"length":1},{"begin":28,"length":8}]},{"pool":4,"snaps":[{"begin":2,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1}]},{"pool":6,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":2,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":1}]},{"pool":20,"snaps":[{"begin":2,"length":4}]},{"pool":21,"snaps":[{"begin":2,"length":1}]},{"pool":22,"snaps":[{"begin":2,"length":1}]},{"pool":23,"snaps":[{"begin":2,"length":1}]},{"pool":24,"snaps":[{"begin":2,"length":1}]},{"pool":25,"snaps":[{"begin":2,"length":1}]},{"pool":26,"snaps":[{"begin":2,"length":1}]},{"pool":27,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:52:58.498 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T07:52:58.498 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:52:58.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:58.611+0000 7f6de5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:58.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:58.623+0000 7f6de5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:58.636 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-16T07:52:58.636 INFO:teuthology.orchestra.run.smithi151.stdout: "success": "" 2024-09-16T07:52:58.637 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-16T07:52:58.648 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T07:52:58.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:58.752+0000 7f82c3d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:58.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:58.760+0000 7f82c3d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:58.948 INFO:teuthology.orchestra.run.smithi151.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T07:52:58.966 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T07:52:58.967 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:52:59.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:59.070+0000 7efc09f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:59.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:59.082+0000 7efc09f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:59.098 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-16T07:52:59.098 INFO:teuthology.orchestra.run.smithi151.stdout: "success": "" 2024-09-16T07:52:59.098 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-16T07:52:59.109 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T07:52:59.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:59.212+0000 7f0e1c4a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:59.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:59.221+0000 7f0e1c4a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:59.409 INFO:teuthology.orchestra.run.smithi151.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T07:52:59.424 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T07:52:59.424 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:52:59.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:59.533+0000 7f6f28591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:59.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:59.545+0000 7f6f28591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:59.560 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-16T07:52:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: "success": "" 2024-09-16T07:52:59.560 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-16T07:52:59.571 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T07:52:59.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:59.675+0000 7fd9d9f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:59.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:59.683+0000 7fd9d9f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:59.870 INFO:teuthology.orchestra.run.smithi151.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T07:52:59.890 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:59.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:52:59.994+0000 7f2d28d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:00.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:53:00.002+0000 7f2d28d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:00.182 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:53:00.183 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2024-09-16T07:53:00.195 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":624,"stamp":"2024-09-16T07:52:59.312679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":11860,"kb_used_data":11860,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156881324,"statfs":{"total":160658620416,"available":160646475776,"internally_reserved":0,"allocated":12144640,"data_stored":12144640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.689841"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.629557+0000","last_change":"2024-09-16T07:38:55.253872+0000","last_active":"2024-09-16T07:52:48.629557+0000","last_peered":"2024-09-16T07:52:48.629557+0000","last_clean":"2024-09-16T07:52:48.629557+0000","last_became_active":"2024-09-16T07:38:53.368303+0000","last_became_peered":"2024-09-16T07:38:53.368303+0000","last_unstale":"2024-09-16T07:52:48.629557+0000","last_undegraded":"2024-09-16T07:52:48.629557+0000","last_fullsized":"2024-09-16T07:52:48.629557+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.635109+0000","last_change":"2024-09-16T07:38:55.258470+0000","last_active":"2024-09-16T07:52:48.635109+0000","last_peered":"2024-09-16T07:52:48.635109+0000","last_clean":"2024-09-16T07:52:48.635109+0000","last_became_active":"2024-09-16T07:38:53.421597+0000","last_became_peered":"2024-09-16T07:38:53.421597+0000","last_unstale":"2024-09-16T07:52:48.635109+0000","last_undegraded":"2024-09-16T07:52:48.635109+0000","last_fullsized":"2024-09-16T07:52:48.635109+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.633571+0000","last_change":"2024-09-16T07:38:55.254755+0000","last_active":"2024-09-16T07:52:48.633571+0000","last_peered":"2024-09-16T07:52:48.633571+0000","last_clean":"2024-09-16T07:52:48.633571+0000","last_became_active":"2024-09-16T07:38:53.390728+0000","last_became_peered":"2024-09-16T07:38:53.390728+0000","last_unstale":"2024-09-16T07:52:48.633571+0000","last_undegraded":"2024-09-16T07:52:48.633571+0000","last_fullsized":"2024-09-16T07:52:48.633571+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":564,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.626083+0000","last_change":"2024-09-16T07:38:55.254425+0000","last_active":"2024-09-16T07:52:48.626083+0000","last_peered":"2024-09-16T07:52:48.626083+0000","last_clean":"2024-09-16T07:52:48.626083+0000","last_became_active":"2024-09-16T07:38:53.383421+0000","last_became_peered":"2024-09-16T07:38:53.383421+0000","last_unstale":"2024-09-16T07:52:48.626083+0000","last_undegraded":"2024-09-16T07:52:48.626083+0000","last_fullsized":"2024-09-16T07:52:48.626083+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":569,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.649234+0000","last_change":"2024-09-16T07:38:55.254427+0000","last_active":"2024-09-16T07:52:49.649234+0000","last_peered":"2024-09-16T07:52:49.649234+0000","last_clean":"2024-09-16T07:52:49.649234+0000","last_became_active":"2024-09-16T07:38:53.455109+0000","last_became_peered":"2024-09-16T07:38:53.455109+0000","last_unstale":"2024-09-16T07:52:49.649234+0000","last_undegraded":"2024-09-16T07:52:49.649234+0000","last_fullsized":"2024-09-16T07:52:49.649234+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":567,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.647765+0000","last_change":"2024-09-16T07:38:55.257328+0000","last_active":"2024-09-16T07:52:49.647765+0000","last_peered":"2024-09-16T07:52:49.647765+0000","last_clean":"2024-09-16T07:52:49.647765+0000","last_became_active":"2024-09-16T07:38:53.437900+0000","last_became_peered":"2024-09-16T07:38:53.437900+0000","last_unstale":"2024-09-16T07:52:49.647765+0000","last_undegraded":"2024-09-16T07:52:49.647765+0000","last_fullsized":"2024-09-16T07:52:49.647765+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":567,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.647027+0000","last_change":"2024-09-16T07:38:55.250937+0000","last_active":"2024-09-16T07:52:49.647027+0000","last_peered":"2024-09-16T07:52:49.647027+0000","last_clean":"2024-09-16T07:52:49.647027+0000","last_became_active":"2024-09-16T07:38:53.392759+0000","last_became_peered":"2024-09-16T07:38:53.392759+0000","last_unstale":"2024-09-16T07:52:49.647027+0000","last_undegraded":"2024-09-16T07:52:49.647027+0000","last_fullsized":"2024-09-16T07:52:49.647027+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":565,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.635722+0000","last_change":"2024-09-16T07:38:55.258108+0000","last_active":"2024-09-16T07:52:48.635722+0000","last_peered":"2024-09-16T07:52:48.635722+0000","last_clean":"2024-09-16T07:52:48.635722+0000","last_became_active":"2024-09-16T07:38:53.396984+0000","last_became_peered":"2024-09-16T07:38:53.396984+0000","last_unstale":"2024-09-16T07:52:48.635722+0000","last_undegraded":"2024-09-16T07:52:48.635722+0000","last_fullsized":"2024-09-16T07:52:48.635722+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":633,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T07:52:48.630253+0000","last_change":"2024-09-16T07:38:52.292504+0000","last_active":"2024-09-16T07:52:48.630253+0000","last_peered":"2024-09-16T07:52:48.630253+0000","last_clean":"2024-09-16T07:52:48.630253+0000","last_became_active":"2024-09-16T07:38:52.263855+0000","last_became_peered":"2024-09-16T07:38:52.263855+0000","last_unstale":"2024-09-16T07:52:48.630253+0000","last_undegraded":"2024-09-16T07:52:48.630253+0000","last_fullsized":"2024-09-16T07:52:48.630253+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:51.189171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:51.189171+0000","last_clean_scrub_stamp":"2024-09-16T07:38:51.189171+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160646406144,"internally_reserved":0,"allocated":12214272,"data_stored":12214272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3348,"kb_used_data":3348,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294380,"statfs":{"total":53552873472,"available":53549445120,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739206,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4436,"kb_used_data":4436,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293292,"statfs":{"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4076,"kb_used_data":4076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293652,"statfs":{"total":53552873472,"available":53548699648,"internally_reserved":0,"allocated":4173824,"data_stored":4173824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53548699648,"internally_reserved":0,"allocated":4173824,"data_stored":4173824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53548331008,"internally_reserved":0,"allocated":4542464,"data_stored":4542464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53549375488,"internally_reserved":0,"allocated":3497984,"data_stored":3497984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:00.199 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T07:38:52.195291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=57, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:00.199 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T07:38:52.195291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=57, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:00.199 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T07:38:52.195291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=57, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:00.200 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T07:38:52.195291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=57, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:00.200 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T07:38:52.195291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=57, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:00.200 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T07:38:52.195291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=57, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:00.200 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T07:38:52.195291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=57, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:00.200 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T07:38:52.195291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=57, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:00.200 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T07:38:51.189171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=51, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=57, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:00.201 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T07:53:20.201 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:20.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:53:20.322+0000 7fac49191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:20.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:53:20.329+0000 7fac49191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:20.511 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:53:20.511 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2024-09-16T07:53:20.524 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":634,"stamp":"2024-09-16T07:53:19.317669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":10460,"kb_used_data":10460,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156882724,"statfs":{"total":160658620416,"available":160647909376,"internally_reserved":0,"allocated":10711040,"data_stored":10711040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003186"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":590,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-16T07:52:59.416277+0000","last_change":"2024-09-16T07:52:59.453979+0000","last_active":"2024-09-16T07:52:59.416277+0000","last_peered":"2024-09-16T07:52:59.416277+0000","last_clean":"2024-09-16T07:52:59.416277+0000","last_became_active":"2024-09-16T07:38:53.368303+0000","last_became_peered":"2024-09-16T07:38:53.368303+0000","last_unstale":"2024-09-16T07:52:59.416277+0000","last_undegraded":"2024-09-16T07:52:59.416277+0000","last_fullsized":"2024-09-16T07:52:59.416277+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:59.453768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:59.453768+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":590,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-16T07:52:59.415852+0000","last_change":"2024-09-16T07:52:59.446881+0000","last_active":"2024-09-16T07:52:59.415852+0000","last_peered":"2024-09-16T07:52:59.415852+0000","last_clean":"2024-09-16T07:52:59.415852+0000","last_became_active":"2024-09-16T07:38:53.421597+0000","last_became_peered":"2024-09-16T07:38:53.421597+0000","last_unstale":"2024-09-16T07:52:59.415852+0000","last_undegraded":"2024-09-16T07:52:59.415852+0000","last_fullsized":"2024-09-16T07:52:59.415852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:59.446589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:59.446589+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":590,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-16T07:52:59.414889+0000","last_change":"2024-09-16T07:52:59.456631+0000","last_active":"2024-09-16T07:52:59.414889+0000","last_peered":"2024-09-16T07:52:59.414889+0000","last_clean":"2024-09-16T07:52:59.414889+0000","last_became_active":"2024-09-16T07:38:53.390728+0000","last_became_peered":"2024-09-16T07:38:53.390728+0000","last_unstale":"2024-09-16T07:52:59.414889+0000","last_undegraded":"2024-09-16T07:52:59.414889+0000","last_fullsized":"2024-09-16T07:52:59.414889+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:59.456455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:59.456455+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":590,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-16T07:52:59.413533+0000","last_change":"2024-09-16T07:52:59.451846+0000","last_active":"2024-09-16T07:52:59.413533+0000","last_peered":"2024-09-16T07:52:59.413533+0000","last_clean":"2024-09-16T07:52:59.413533+0000","last_became_active":"2024-09-16T07:38:53.383421+0000","last_became_peered":"2024-09-16T07:38:53.383421+0000","last_unstale":"2024-09-16T07:52:59.413533+0000","last_undegraded":"2024-09-16T07:52:59.413533+0000","last_fullsized":"2024-09-16T07:52:59.413533+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:59.451647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:59.451647+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":569,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.649234+0000","last_change":"2024-09-16T07:38:55.254427+0000","last_active":"2024-09-16T07:52:49.649234+0000","last_peered":"2024-09-16T07:52:49.649234+0000","last_clean":"2024-09-16T07:52:49.649234+0000","last_became_active":"2024-09-16T07:38:53.455109+0000","last_became_peered":"2024-09-16T07:38:53.455109+0000","last_unstale":"2024-09-16T07:52:49.649234+0000","last_undegraded":"2024-09-16T07:52:49.649234+0000","last_fullsized":"2024-09-16T07:52:49.649234+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":567,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.647765+0000","last_change":"2024-09-16T07:38:55.257328+0000","last_active":"2024-09-16T07:52:49.647765+0000","last_peered":"2024-09-16T07:52:49.647765+0000","last_clean":"2024-09-16T07:52:49.647765+0000","last_became_active":"2024-09-16T07:38:53.437900+0000","last_became_peered":"2024-09-16T07:38:53.437900+0000","last_unstale":"2024-09-16T07:52:49.647765+0000","last_undegraded":"2024-09-16T07:52:49.647765+0000","last_fullsized":"2024-09-16T07:52:49.647765+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":567,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.647027+0000","last_change":"2024-09-16T07:38:55.250937+0000","last_active":"2024-09-16T07:52:49.647027+0000","last_peered":"2024-09-16T07:52:49.647027+0000","last_clean":"2024-09-16T07:52:49.647027+0000","last_became_active":"2024-09-16T07:38:53.392759+0000","last_became_peered":"2024-09-16T07:38:53.392759+0000","last_unstale":"2024-09-16T07:52:49.647027+0000","last_undegraded":"2024-09-16T07:52:49.647027+0000","last_fullsized":"2024-09-16T07:52:49.647027+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:52.195291+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":591,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-16T07:52:59.413502+0000","last_change":"2024-09-16T07:52:59.444230+0000","last_active":"2024-09-16T07:52:59.413502+0000","last_peered":"2024-09-16T07:52:59.413502+0000","last_clean":"2024-09-16T07:52:59.413502+0000","last_became_active":"2024-09-16T07:38:53.396984+0000","last_became_peered":"2024-09-16T07:38:53.396984+0000","last_unstale":"2024-09-16T07:52:59.413502+0000","last_undegraded":"2024-09-16T07:52:59.413502+0000","last_fullsized":"2024-09-16T07:52:59.413502+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'1","last_scrub_stamp":"2024-09-16T07:52:59.443893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:59.443893+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":659,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-16T07:52:59.411411+0000","last_change":"2024-09-16T07:52:59.471630+0000","last_active":"2024-09-16T07:52:59.411411+0000","last_peered":"2024-09-16T07:52:59.411411+0000","last_clean":"2024-09-16T07:52:59.411411+0000","last_became_active":"2024-09-16T07:38:52.263855+0000","last_became_peered":"2024-09-16T07:38:52.263855+0000","last_unstale":"2024-09-16T07:52:59.411411+0000","last_undegraded":"2024-09-16T07:52:59.411411+0000","last_fullsized":"2024-09-16T07:52:59.411411+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'52","last_scrub_stamp":"2024-09-16T07:52:59.471417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:59.471417+0000","last_clean_scrub_stamp":"2024-09-16T07:38:51.189171+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160647839744,"internally_reserved":0,"allocated":10780672,"data_stored":10780672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53549764608,"internally_reserved":0,"allocated":3108864,"data_stored":3108864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3348,"kb_used_data":3348,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294380,"statfs":{"total":53552873472,"available":53549445120,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739236,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3036,"kb_used_data":3036,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294692,"statfs":{"total":53552873472,"available":53549764608,"internally_reserved":0,"allocated":3108864,"data_stored":3108864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4076,"kb_used_data":4076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293652,"statfs":{"total":53552873472,"available":53548699648,"internally_reserved":0,"allocated":4173824,"data_stored":4173824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53549764608,"internally_reserved":0,"allocated":3108864,"data_stored":3108864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53548699648,"internally_reserved":0,"allocated":4173824,"data_stored":4173824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53549764608,"internally_reserved":0,"allocated":3108864,"data_stored":3108864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53549375488,"internally_reserved":0,"allocated":3497984,"data_stored":3497984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:20.525 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T07:38:52.195291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=57, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:20.525 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T07:38:52.195291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=57, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:20.526 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T07:38:52.195291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=57, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:20.526 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T07:53:40.527 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:40.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:53:40.646+0000 7fe7e76bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:53:40.654+0000 7fe7e76bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:40.837 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-16T07:53:40.838 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2024-09-16T07:53:40.850 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":644,"stamp":"2024-09-16T07:53:39.322562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":7676,"kb_used_data":7676,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156885508,"statfs":{"total":160658620416,"available":160650760192,"internally_reserved":0,"allocated":7860224,"data_stored":7860224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003033"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":590,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-16T07:52:59.416277+0000","last_change":"2024-09-16T07:52:59.453979+0000","last_active":"2024-09-16T07:52:59.416277+0000","last_peered":"2024-09-16T07:52:59.416277+0000","last_clean":"2024-09-16T07:52:59.416277+0000","last_became_active":"2024-09-16T07:38:53.368303+0000","last_became_peered":"2024-09-16T07:38:53.368303+0000","last_unstale":"2024-09-16T07:52:59.416277+0000","last_undegraded":"2024-09-16T07:52:59.416277+0000","last_fullsized":"2024-09-16T07:52:59.416277+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:59.453768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:59.453768+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":590,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-16T07:52:59.415852+0000","last_change":"2024-09-16T07:52:59.446881+0000","last_active":"2024-09-16T07:52:59.415852+0000","last_peered":"2024-09-16T07:52:59.415852+0000","last_clean":"2024-09-16T07:52:59.415852+0000","last_became_active":"2024-09-16T07:38:53.421597+0000","last_became_peered":"2024-09-16T07:38:53.421597+0000","last_unstale":"2024-09-16T07:52:59.415852+0000","last_undegraded":"2024-09-16T07:52:59.415852+0000","last_fullsized":"2024-09-16T07:52:59.415852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:59.446589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:59.446589+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":590,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-16T07:52:59.414889+0000","last_change":"2024-09-16T07:52:59.456631+0000","last_active":"2024-09-16T07:52:59.414889+0000","last_peered":"2024-09-16T07:52:59.414889+0000","last_clean":"2024-09-16T07:52:59.414889+0000","last_became_active":"2024-09-16T07:38:53.390728+0000","last_became_peered":"2024-09-16T07:38:53.390728+0000","last_unstale":"2024-09-16T07:52:59.414889+0000","last_undegraded":"2024-09-16T07:52:59.414889+0000","last_fullsized":"2024-09-16T07:52:59.414889+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:59.456455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:59.456455+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":590,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-16T07:52:59.413533+0000","last_change":"2024-09-16T07:52:59.451846+0000","last_active":"2024-09-16T07:52:59.413533+0000","last_peered":"2024-09-16T07:52:59.413533+0000","last_clean":"2024-09-16T07:52:59.413533+0000","last_became_active":"2024-09-16T07:38:53.383421+0000","last_became_peered":"2024-09-16T07:38:53.383421+0000","last_unstale":"2024-09-16T07:52:59.413533+0000","last_undegraded":"2024-09-16T07:52:59.413533+0000","last_fullsized":"2024-09-16T07:52:59.413533+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:59.451647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:59.451647+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":592,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-16T07:52:58.951881+0000","last_change":"2024-09-16T07:52:58.971652+0000","last_active":"2024-09-16T07:52:58.951881+0000","last_peered":"2024-09-16T07:52:58.951881+0000","last_clean":"2024-09-16T07:52:58.951881+0000","last_became_active":"2024-09-16T07:38:53.455109+0000","last_became_peered":"2024-09-16T07:38:53.455109+0000","last_unstale":"2024-09-16T07:52:58.951881+0000","last_undegraded":"2024-09-16T07:52:58.951881+0000","last_fullsized":"2024-09-16T07:52:58.951881+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2024-09-16T07:52:58.971469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:58.971469+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":590,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-16T07:52:59.876831+0000","last_change":"2024-09-16T07:52:59.892258+0000","last_active":"2024-09-16T07:52:59.876831+0000","last_peered":"2024-09-16T07:52:59.876831+0000","last_clean":"2024-09-16T07:52:59.876831+0000","last_became_active":"2024-09-16T07:38:53.437900+0000","last_became_peered":"2024-09-16T07:38:53.437900+0000","last_unstale":"2024-09-16T07:52:59.876831+0000","last_undegraded":"2024-09-16T07:52:59.876831+0000","last_fullsized":"2024-09-16T07:52:59.876831+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:59.892063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:59.892063+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":590,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-16T07:52:59.874620+0000","last_change":"2024-09-16T07:52:59.890038+0000","last_active":"2024-09-16T07:52:59.874620+0000","last_peered":"2024-09-16T07:52:59.874620+0000","last_clean":"2024-09-16T07:52:59.874620+0000","last_became_active":"2024-09-16T07:38:53.392759+0000","last_became_peered":"2024-09-16T07:38:53.392759+0000","last_unstale":"2024-09-16T07:52:59.874620+0000","last_undegraded":"2024-09-16T07:52:59.874620+0000","last_fullsized":"2024-09-16T07:52:59.874620+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:59.889720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:59.889720+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":591,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-16T07:52:59.413502+0000","last_change":"2024-09-16T07:52:59.444230+0000","last_active":"2024-09-16T07:52:59.413502+0000","last_peered":"2024-09-16T07:52:59.413502+0000","last_clean":"2024-09-16T07:52:59.413502+0000","last_became_active":"2024-09-16T07:38:53.396984+0000","last_became_peered":"2024-09-16T07:38:53.396984+0000","last_unstale":"2024-09-16T07:52:59.413502+0000","last_undegraded":"2024-09-16T07:52:59.413502+0000","last_fullsized":"2024-09-16T07:52:59.413502+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'1","last_scrub_stamp":"2024-09-16T07:52:59.443893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:59.443893+0000","last_clean_scrub_stamp":"2024-09-16T07:38:52.195291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":659,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-16T07:52:59.411411+0000","last_change":"2024-09-16T07:52:59.471630+0000","last_active":"2024-09-16T07:52:59.411411+0000","last_peered":"2024-09-16T07:52:59.411411+0000","last_clean":"2024-09-16T07:52:59.411411+0000","last_became_active":"2024-09-16T07:38:52.263855+0000","last_became_peered":"2024-09-16T07:38:52.263855+0000","last_unstale":"2024-09-16T07:52:59.411411+0000","last_undegraded":"2024-09-16T07:52:59.411411+0000","last_fullsized":"2024-09-16T07:52:59.411411+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'52","last_scrub_stamp":"2024-09-16T07:52:59.471417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:59.471417+0000","last_clean_scrub_stamp":"2024-09-16T07:38:51.189171+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160650760192,"internally_reserved":0,"allocated":7860224,"data_stored":7860224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53549764608,"internally_reserved":0,"allocated":3108864,"data_stored":3108864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1860,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295868,"statfs":{"total":53552873472,"available":53550968832,"internally_reserved":0,"allocated":1904640,"data_stored":1904640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739236,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3036,"kb_used_data":3036,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294692,"statfs":{"total":53552873472,"available":53549764608,"internally_reserved":0,"allocated":3108864,"data_stored":3108864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706528,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2780,"kb_used_data":2780,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294948,"statfs":{"total":53552873472,"available":53550026752,"internally_reserved":0,"allocated":2846720,"data_stored":2846720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53549764608,"internally_reserved":0,"allocated":3108864,"data_stored":3108864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550026752,"internally_reserved":0,"allocated":2846720,"data_stored":2846720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53549764608,"internally_reserved":0,"allocated":3108864,"data_stored":3108864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550968832,"internally_reserved":0,"allocated":1904640,"data_stored":1904640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:40.852 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T07:53:40.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:53:40.954+0000 7ff9c4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:40.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-16T07:53:40.965+0000 7ff9c4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:41.167 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T07:53:41.167 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T07:53:41.168 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T07:53:41.168 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:53:41.250 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T07:53:41.251 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T07:53:41.251 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:53:41.335 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T07:53:41.336 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T07:53:41.336 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:53:41.413 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T07:53:41.414 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T07:53:41.414 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T07:53:41.414 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:53:41.443 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T07:53:41.443 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T07:53:41.443 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T07:53:41.443 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:53:41.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-16T07:53:41.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-16T07:53:41.497 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T07:53:41.497 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T07:53:41.497 DEBUG:teuthology.orchestra.run.smithi151:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'is full \(reached quota' | egrep -v '\(POOL_FULL\)' | head -n 1 2024-09-16T07:53:41.567 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-16T07:53:41.567 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T07:53:41.751 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-16T07:53:41.752 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T07:53:41.856 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-16T07:53:41.857 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T07:53:41.914 INFO:tasks.ceph:Archiving mon data... 2024-09-16T07:53:41.916 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906865/data/mon.a.tgz 2024-09-16T07:53:41.916 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-09-16T07:53:41.932 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.bE3Pdo6THZ 2024-09-16T07:53:41.933 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.bE3Pdo6THZ 2024-09-16T07:53:42.083 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.bE3Pdo6THZ 2024-09-16T07:53:42.167 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.bE3Pdo6THZ is 263KB 2024-09-16T07:53:42.263 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.bE3Pdo6THZ 2024-09-16T07:53:42.278 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T07:53:42.279 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T07:53:42.398 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T07:53:42.399 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T07:53:42.401 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906865/remote/smithi151/crash 2024-09-16T07:53:42.402 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T07:53:42.464 INFO:tasks.ceph:Compressing logs... 2024-09-16T07:53:42.464 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T07:53:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T07:53:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31323.log 2024-09-16T07:53:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33025.log 2024-09-16T07:53:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.31323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33109.log 2024-09-16T07:53:42.557 INFO:teuthology.orchestra.run.smithi151.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.31323.log.gz 2024-09-16T07:53:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.33025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32429.log 2024-09-16T07:53:42.558 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33025.log.gz 2024-09-16T07:53:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.33109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32983.log 2024-09-16T07:53:42.558 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33109.log.gz 2024-09-16T07:53:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.32429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28719.log 2024-09-16T07:53:42.558 INFO:teuthology.orchestra.run.smithi151.stderr: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.32429.log.gz 2024-09-16T07:53:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.32983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28775.log 2024-09-16T07:53:42.558 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32983.log.gz 2024-09-16T07:53:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.28719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32941.log 2024-09-16T07:53:42.558 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28719.log.gz 2024-09-16T07:53:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.28775.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T07:53:42.558 INFO:teuthology.orchestra.run.smithi151.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.28775.log.gz 2024-09-16T07:53:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.32941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32677.log 2024-09-16T07:53:42.559 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32941.log.gz 2024-09-16T07:53:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28548.log 2024-09-16T07:53:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.32677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31451.log 2024-09-16T07:53:42.559 INFO:teuthology.orchestra.run.smithi151.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.32677.log.gz 2024-09-16T07:53:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.28548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29164.log 2024-09-16T07:53:42.559 INFO:teuthology.orchestra.run.smithi151.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28548.log.gz 2024-09-16T07:53:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.31451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29077.log 2024-09-16T07:53:42.559 INFO:teuthology.orchestra.run.smithi151.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.31451.log.gz 2024-09-16T07:53:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33359.log 2024-09-16T07:53:42.559 INFO:teuthology.orchestra.run.smithi151.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29164.log.gz 2024-09-16T07:53:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28912.log 2024-09-16T07:53:42.559 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29077.log.gz 2024-09-16T07:53:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.33359.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33359.log.gz 2024-09-16T07:53:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29374.log 2024-09-16T07:53:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.28912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33319.log 2024-09-16T07:53:42.560 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28912.log.gz 2024-09-16T07:53:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32857.log 2024-09-16T07:53:42.560 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29374.log.gz 2024-09-16T07:53:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.33319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28578.log 2024-09-16T07:53:42.560 INFO:teuthology.orchestra.run.smithi151.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33319.log.gz 2024-09-16T07:53:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.32857.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T07:53:42.560 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32857.log.gz 2024-09-16T07:53:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.28578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33277.log 2024-09-16T07:53:42.561 INFO:teuthology.orchestra.run.smithi151.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.28578.log.gz 2024-09-16T07:53:42.561 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29204.log 2024-09-16T07:53:42.561 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.33277.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33277.log.gz 2024-09-16T07:53:42.561 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28101.log 2024-09-16T07:53:42.561 INFO:teuthology.orchestra.run.smithi151.stderr: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T07:53:42.561 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32628.log 2024-09-16T07:53:42.561 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29204.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29204.log.gz 2024-09-16T07:53:42.561 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.28101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31824.log 2024-09-16T07:53:42.561 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28101.log.gz 2024-09-16T07:53:42.561 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.32628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31775.log 2024-09-16T07:53:42.561 INFO:teuthology.orchestra.run.smithi151.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.32628.log.gz 2024-09-16T07:53:42.561 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.31824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31647.log 2024-09-16T07:53:42.561 INFO:teuthology.orchestra.run.smithi151.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31824.log.gz 2024-09-16T07:53:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.31775.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27153.log 2024-09-16T07:53:42.562 INFO:teuthology.orchestra.run.smithi151.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.31775.log.gz 2024-09-16T07:53:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.31647.log: 82.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.31647.log.gz 2024-09-16T07:53:42.562 INFO:teuthology.orchestra.run.smithi151.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.28386.log 2024-09-16T07:53:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph.tmp-client.admin.27153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31711.log 2024-09-16T07:53:42.562 INFO:teuthology.orchestra.run.smithi151.stderr: 68.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27153.log.gz 2024-09-16T07:53:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.28386.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.28299.log -- replaced with /var/log/ceph/ceph-client.admin.28386.log.gz 2024-09-16T07:53:42.562 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-16T07:53:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.31711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32899.log 2024-09-16T07:53:42.562 INFO:teuthology.orchestra.run.smithi151.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.31711.log.gz 2024-09-16T07:53:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.28299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32380.log 2024-09-16T07:53:42.563 INFO:teuthology.orchestra.run.smithi151.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28299.log.gz 2024-09-16T07:53:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.32899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28800.log 2024-09-16T07:53:42.563 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32899.log.gz 2024-09-16T07:53:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.32380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32530.log 2024-09-16T07:53:42.563 INFO:teuthology.orchestra.run.smithi151.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.32380.log.gz 2024-09-16T07:53:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.28800.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T07:53:42.563 INFO:teuthology.orchestra.run.smithi151.stderr: 65.6% -- replaced with /var/log/ceph/ceph-client.admin.28800.log.gz 2024-09-16T07:53:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.32530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32481.log 2024-09-16T07:53:42.563 INFO:teuthology.orchestra.run.smithi151.stderr: 76.2% -- replaced with /var/log/ceph/ceph-client.admin.32530.log.gz 2024-09-16T07:53:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29290.log 2024-09-16T07:53:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.32481.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T07:53:42.563 INFO:teuthology.orchestra.run.smithi151.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.32481.log.gz 2024-09-16T07:53:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28954.log 2024-09-16T07:53:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29290.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29290.log.gz 2024-09-16T07:53:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29203.log 2024-09-16T07:53:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.28954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28339.log 2024-09-16T07:53:42.564 INFO:teuthology.orchestra.run.smithi151.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28954.log.gz 2024-09-16T07:53:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29203.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T07:53:42.564 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29203.log.gz 2024-09-16T07:53:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.28339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33193.log 2024-09-16T07:53:42.564 INFO:teuthology.orchestra.run.smithi151.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28339.log.gz 2024-09-16T07:53:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31387.log 2024-09-16T07:53:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.33193.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33193.log.gz 2024-09-16T07:53:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T07:53:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.31387.log: gzip -5 --verbose 82.1% -- replaced with /var/log/ceph/ceph-client.admin.31387.log.gz 2024-09-16T07:53:42.565 INFO:teuthology.orchestra.run.smithi151.stderr: -- /var/log/ceph/ceph-client.admin.28996.log 2024-09-16T07:53:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32815.log 2024-09-16T07:53:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.28996.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28996.log.gz 2024-09-16T07:53:42.565 INFO:teuthology.orchestra.run.smithi151.stderr: 88.1% -5 --verbose -- /var/log/ceph/ceph-client.admin.33235.log 2024-09-16T07:53:42.565 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T07:53:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29076.log 2024-09-16T07:53:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.32815.log: /var/log/ceph/ceph-client.admin.33235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29078.log 48.4% 2024-09-16T07:53:42.565 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33235.log.gz 2024-09-16T07:53:42.565 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32815.log.gz 2024-09-16T07:53:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29076.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29076.log.gz 2024-09-16T07:53:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32579.log 2024-09-16T07:53:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33067.log 2024-09-16T07:53:42.566 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29078.log: /var/log/ceph/ceph-client.admin.32579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33151.log 2024-09-16T07:53:42.566 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29078.log.gz 2024-09-16T07:53:42.566 INFO:teuthology.orchestra.run.smithi151.stderr: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.32579.log.gz/var/log/ceph/ceph-client.admin.33067.log: 2024-09-16T07:53:42.566 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33067.log.gz 2024-09-16T07:53:42.566 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31259.log 2024-09-16T07:53:42.566 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29592.log 2024-09-16T07:53:42.566 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.33151.log: /var/log/ceph/ceph-client.admin.31259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31518.log 2024-09-16T07:53:42.566 INFO:teuthology.orchestra.run.smithi151.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.31259.log.gz 2024-09-16T07:53:42.566 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29592.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33151.log.gz 2024-09-16T07:53:42.566 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28870.log 2024-09-16T07:53:42.566 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.31518.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.29592.log.gz 2024-09-16T07:53:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:gzip 82.2% -- replaced with /var/log/ceph/ceph-client.admin.31518.log.gz 2024-09-16T07:53:42.567 INFO:teuthology.orchestra.run.smithi151.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.28189.log 2024-09-16T07:53:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31876.log 2024-09-16T07:53:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.28870.log: /var/log/ceph/ceph-client.admin.28189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29332.log 2024-09-16T07:53:42.567 INFO:teuthology.orchestra.run.smithi151.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.28870.log.gz 2024-09-16T07:53:42.567 INFO:teuthology.orchestra.run.smithi151.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28189.log.gz 2024-09-16T07:53:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.31876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31582.log 2024-09-16T07:53:42.567 INFO:teuthology.orchestra.run.smithi151.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.31876.log.gz 2024-09-16T07:53:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29332.log: 49.6%/var/log/ceph/ceph-client.admin.31582.log: -- replaced with /var/log/ceph/ceph-client.admin.29332.log.gz 2024-09-16T07:53:42.567 INFO:teuthology.orchestra.run.smithi151.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.31582.log.gz 2024-09-16T07:53:42.627 INFO:teuthology.orchestra.run.smithi151.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T07:53:42.867 INFO:teuthology.orchestra.run.smithi151.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T07:53:46.414 INFO:teuthology.orchestra.run.smithi151.stderr: 96.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T07:53:46.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-16T07:53:46.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-16T07:53:46.502 INFO:teuthology.orchestra.run.smithi151.stderr: 96.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T07:53:47.185 INFO:teuthology.orchestra.run.smithi151.stderr: 96.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T07:53:47.187 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-16T07:53:47.187 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m4.668s 2024-09-16T07:53:47.188 INFO:teuthology.orchestra.run.smithi151.stderr:user 0m12.326s 2024-09-16T07:53:47.188 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m0.629s 2024-09-16T07:53:47.188 INFO:tasks.ceph:Archiving logs... 2024-09-16T07:53:47.189 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906865/remote/smithi151/log 2024-09-16T07:53:47.190 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T07:53:48.728 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T07:53:48.738 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T07:53:48.738 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T07:53:48.803 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T07:53:48.811 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T07:53:48.811 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:53:48.831 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2024-09-16T07:53:48.836 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T07:53:48.836 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2024-09-16T07:53:48.836 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv01.front.sepia.ceph.com 3 7 377 46 +2297us[+2435us] +/- 66ms 2024-09-16T07:53:48.836 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 -4640us[-4502us] +/- 57ms 2024-09-16T07:53:48.836 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 +2287us[+2425us] +/- 60ms 2024-09-16T07:53:48.836 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:53:48.837 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T07:53:48.846 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T07:53:48.846 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T07:53:48.856 DEBUG:teuthology.orchestra.run.smithi151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T07:53:48.944 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T07:53:48.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:53:48.972 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T07:53:48.981 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T07:53:48.989 INFO:teuthology.task.internal:Duration was 1312.759602 seconds 2024-09-16T07:53:48.990 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T07:53:48.999 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T07:53:48.999 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T07:53:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T07:53:49.314 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T07:53:49.315 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2024-09-16T07:53:49.315 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T07:53:49.376 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T07:53:49.376 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T07:53:49.443 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T07:53:49.443 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T07:53:49.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T07:53:49.599 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T07:53:49.599 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T07:53:49.624 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T07:53:50.194 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T07:53:50.219 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2024-09-16T07:53:50.232 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T07:53:50.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:53:50.289 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T07:53:50.351 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T07:53:50.352 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906865/remote/smithi151 2024-09-16T07:53:50.352 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T07:53:50.386 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T07:53:50.386 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T07:53:50.436 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T07:53:50.446 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T07:53:50.446 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T07:53:50.457 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T07:53:50.457 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T07:53:50.492 INFO:teuthology.orchestra.run.smithi151.stdout: 265340 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 07:53 /home/ubuntu/cephtest 2024-09-16T07:53:50.493 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T07:53:50.503 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T07:53:50.526 INFO:teuthology.run:Summary data: description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rbd_api_tests_old_format} duration: 1312.7596018314362 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-16T07:53:50.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T07:53:50.611 INFO:teuthology.run:pass