2024-09-11T14:01:30.114 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T14:01:30.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T14:01:30.209 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901312 branch: wip-matanb-crimson-testing-sep11 description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rbd_api_tests_old_format} email: null first_in_suite: false job_id: '7901312' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-sep11 ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug ms: 1 debug osd: 20 osd objectstore: seastore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-1 osd.1: crimson seastar cpu cores: 2-3 osd.2: crimson seastar cpu cores: 4-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_APP_NOT_ENABLED\) - is full \(reached quota - \(POOL_FULL\) sha1: e7a65bf96d25c503998be3c193e951647cc62cab ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: crimson sha1: e7a65bf96d25c503998be3c193e951647cc62cab selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 2853 sha1: e7a65bf96d25c503998be3c193e951647cc62cab sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPpAKMPo9OB72V6/hSoqFlGlXcGAW826jG86Gt/dyA6N38/6TvXltM3S72e1XHFC+O/zBrrAuJCaWYSs857XVMI= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rbd/crimson/test_crimson_librbd.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_13:53:46 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T14:01:30.210 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-11T14:01:30.210 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-11T14:01:30.211 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T14:01:30.212 INFO:teuthology.task.internal:Checking packages... 2024-09-11T14:01:30.236 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash 'e7a65bf96d25c503998be3c193e951647cc62cab' 2024-09-11T14:01:30.236 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T14:01:30.236 INFO:teuthology.packaging:ref: None 2024-09-11T14:01:30.236 INFO:teuthology.packaging:tag: None 2024-09-11T14:01:30.237 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-sep11 2024-09-11T14:01:30.237 INFO:teuthology.packaging:sha1: e7a65bf96d25c503998be3c193e951647cc62cab 2024-09-11T14:01:30.237 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-sep11 2024-09-11T14:01:30.386 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4884.ge7a65bf9 2024-09-11T14:01:30.389 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T14:01:30.395 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T14:01:30.395 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T14:01:30.409 INFO:teuthology.task.internal:Saving configuration 2024-09-11T14:01:30.422 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T14:01:30.428 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T14:01:30.453 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901312', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 13:56:21.596982', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPpAKMPo9OB72V6/hSoqFlGlXcGAW826jG86Gt/dyA6N38/6TvXltM3S72e1XHFC+O/zBrrAuJCaWYSs857XVMI='} 2024-09-11T14:01:30.453 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T14:01:30.458 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-09-11T14:01:30.458 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T14:01:30.490 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2da76bbbe0>, signals=[15]) 2024-09-11T14:01:30.490 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T14:01:30.496 INFO:teuthology.task.internal:Opening connections... 2024-09-11T14:01:30.496 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2024-09-11T14:01:30.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:01:30.574 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T14:01:30.582 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-09-11T14:01:30.654 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-09-11T14:01:30.655 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-09-11T14:01:30.712 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2024-09-11T14:01:30.712 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2024-09-11T14:01:30.712 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2024-09-11T14:01:30.713 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2024-09-11T14:01:30.713 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2024-09-11T14:01:30.713 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2024-09-11T14:01:30.713 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T14:01:30.713 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-09-11T14:01:30.713 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2024-09-11T14:01:30.713 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T14:01:30.713 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2024-09-11T14:01:30.714 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T14:01:30.714 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T14:01:30.714 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T14:01:30.714 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-09-11T14:01:30.737 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T14:01:30.745 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T14:01:30.750 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T14:01:30.750 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2024-09-11T14:01:30.769 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T14:01:30.775 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T14:01:30.775 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2024-09-11T14:01:30.834 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T14:01:30.868 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T14:01:30.883 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-11T14:01:30.883 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-11T14:01:30.883 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T14:01:30.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:01:30.900 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-11T14:01:30.957 INFO:teuthology.orchestra.run.smithi150.stdout:5.14.0-503.el9.x86_64 2024-09-11T14:01:30.957 INFO:teuthology.task.kernel:Running kernel on smithi150: 5.14.0-503.el9.x86_64 2024-09-11T14:01:30.957 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum install -y kernel 2024-09-11T14:01:34.489 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-11T14:01:40.298 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - AppStream 4.3 MB/s | 20 MB 00:04 2024-09-11T14:01:45.923 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-11T14:01:47.524 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 19 kB 00:00 2024-09-11T14:01:48.603 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-11T14:01:54.159 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-11T14:01:56.174 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T14:01:56.174 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T14:01:56.256 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:01:56.264 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:01:56.264 INFO:teuthology.orchestra.run.smithi150.stdout: Package Architecture Version Repository Size 2024-09-11T14:01:56.264 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:01:56.264 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:01:56.264 INFO:teuthology.orchestra.run.smithi150.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T14:01:56.264 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-09-11T14:01:56.264 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T14:01:56.264 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T14:01:56.264 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T14:01:56.264 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:01:56.264 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:01:56.264 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:01:56.265 INFO:teuthology.orchestra.run.smithi150.stdout:Install 4 Packages 2024-09-11T14:01:56.265 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:01:56.265 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 79 M 2024-09-11T14:01:56.265 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 126 M 2024-09-11T14:01:56.265 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:01:56.485 INFO:teuthology.orchestra.run.smithi150.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 244 kB/s | 23 kB 00:00 2024-09-11T14:01:56.936 INFO:teuthology.orchestra.run.smithi150.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-11T14:01:57.453 INFO:teuthology.orchestra.run.smithi150.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 33 MB/s | 35 MB 00:01 2024-09-11T14:01:57.712 INFO:teuthology.orchestra.run.smithi150.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 23 MB/s | 29 MB 00:01 2024-09-11T14:01:57.712 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:01:57.712 INFO:teuthology.orchestra.run.smithi150.stdout:Total 54 MB/s | 79 MB 00:01 2024-09-11T14:01:58.394 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:01:58.770 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:01:58.770 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:01:59.721 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:01:59.722 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:02:02.178 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:02:02.837 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:02:02.929 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:02:05.729 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:02:05.872 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:02:10.702 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:02:11.048 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:02:15.871 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:02:54.393 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:02:54.433 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:02:54.747 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:02:54.747 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:02:54.747 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:02:54.747 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:02:55.593 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:02:55.593 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:02:55.593 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:02:55.593 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T14:02:55.593 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T14:02:55.593 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T14:02:55.593 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T14:02:55.593 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:02:55.593 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:02:55.948 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:02:56.033 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:02:56.034 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:02:56.034 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T14:02:56.034 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T14:02:56.034 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T14:02:56.035 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T14:02:56.035 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T14:02:56.035 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:02:56.093 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:02:56.094 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:02:56.094 DEBUG:teuthology.orchestra.run.smithi150:> sudo rpm -qi grub2-tools 2024-09-11T14:02:56.127 INFO:teuthology.orchestra.run.smithi150.stdout:Name : grub2-tools 2024-09-11T14:02:56.128 INFO:teuthology.orchestra.run.smithi150.stdout:Epoch : 1 2024-09-11T14:02:56.128 INFO:teuthology.orchestra.run.smithi150.stdout:Version : 2.06 2024-09-11T14:02:56.128 INFO:teuthology.orchestra.run.smithi150.stdout:Release : 82.el9 2024-09-11T14:02:56.128 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: x86_64 2024-09-11T14:02:56.128 INFO:teuthology.orchestra.run.smithi150.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T14:02:56.128 INFO:teuthology.orchestra.run.smithi150.stdout:Group : Unspecified 2024-09-11T14:02:56.128 INFO:teuthology.orchestra.run.smithi150.stdout:Size : 8274670 2024-09-11T14:02:56.128 INFO:teuthology.orchestra.run.smithi150.stdout:License : GPLv3+ 2024-09-11T14:02:56.128 INFO:teuthology.orchestra.run.smithi150.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T14:02:56.128 INFO:teuthology.orchestra.run.smithi150.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T14:02:56.129 INFO:teuthology.orchestra.run.smithi150.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T14:02:56.129 INFO:teuthology.orchestra.run.smithi150.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T14:02:56.129 INFO:teuthology.orchestra.run.smithi150.stdout:Packager : builder@centos.org 2024-09-11T14:02:56.129 INFO:teuthology.orchestra.run.smithi150.stdout:Vendor : CentOS 2024-09-11T14:02:56.129 INFO:teuthology.orchestra.run.smithi150.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T14:02:56.129 INFO:teuthology.orchestra.run.smithi150.stdout:Summary : Support tools for GRUB. 2024-09-11T14:02:56.129 INFO:teuthology.orchestra.run.smithi150.stdout:Description : 2024-09-11T14:02:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:02:56.129 INFO:teuthology.orchestra.run.smithi150.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T14:02:56.129 INFO:teuthology.orchestra.run.smithi150.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T14:02:56.129 INFO:teuthology.orchestra.run.smithi150.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T14:02:56.129 INFO:teuthology.orchestra.run.smithi150.stdout:hardware devices. 2024-09-11T14:02:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:02:56.130 INFO:teuthology.orchestra.run.smithi150.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T14:02:56.130 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T14:02:56.130 INFO:teuthology.task.kernel:Updating grub on smithi150 to boot 5.14.0-505.el9.x86_64 2024-09-11T14:02:56.131 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T14:02:56.832 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2024-09-11T14:02:58.182 INFO:teuthology.orchestra.run.smithi150.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T14:02:58.206 INFO:teuthology.orchestra.run.smithi150.stderr:done 2024-09-11T14:02:58.208 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-11T14:02:58.224 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.gbASJQdqpu 2024-09-11T14:02:58.225 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gbASJQdqpu 2024-09-11T14:02:58.293 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.gbASJQdqpu 2024-09-11T14:02:58.429 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.gbASJQdqpu is 6KB 2024-09-11T14:02:58.480 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.gbASJQdqpu 2024-09-11T14:02:58.496 DEBUG:teuthology.orchestra.run.smithi150:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T14:02:58.557 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T14:02:58.558 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T14:02:58.558 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T14:02:58.558 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T14:02:58.559 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T14:02:58.719 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2024-09-11T14:03:28.749 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T14:03:28.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-11T14:03:28.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:03:47.133 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-11T14:03:56.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-11T14:03:56.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:03:59.197 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-11T14:04:11.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-11T14:04:11.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:04:29.629 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-11T14:04:44.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-11T14:04:44.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:04:44.985 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-11T14:04:45.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-11T14:04:45.357 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-11T14:04:45.357 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-11T14:04:45.372 INFO:teuthology.orchestra.run.smithi150.stdout:5.14.0-505.el9.x86_64 2024-09-11T14:04:45.372 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T14:04:45.372 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T14:04:45.372 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T14:04:46.373 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T14:04:46.374 DEBUG:teuthology.orchestra.run.smithi150:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T14:04:46.473 INFO:teuthology.orchestra.run.smithi150.stdout:ttyS1 2024-09-11T14:04:46.497 DEBUG:teuthology.parallel:result is None 2024-09-11T14:04:46.497 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T14:04:46.505 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T14:04:46.505 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T14:04:46.519 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T14:04:46.525 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T14:04:46.531 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T14:04:46.531 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T14:04:46.581 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T14:04:46.587 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T14:04:46.587 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T14:04:46.652 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:04:46.662 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:04:46.663 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T14:04:46.673 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T14:04:46.673 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T14:04:46.725 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T14:04:46.735 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T14:04:46.735 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T14:04:46.777 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:04:46.859 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:04:46.902 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:04:46.981 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:04:47.018 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:04:47.019 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T14:04:47.082 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2024-09-11T14:04:47.160 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:04:47.285 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T14:04:47.292 INFO:teuthology.task.internal:Starting timer... 2024-09-11T14:04:47.292 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T14:04:47.306 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T14:04:47.322 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-11T14:04:47.322 DEBUG:teuthology.orchestra.run.smithi150:> sudo service auditd rotate 2024-09-11T14:04:47.374 INFO:teuthology.orchestra.run.smithi150.stdout:Rotating logs: 2024-09-11T14:04:47.375 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T14:04:47.376 DEBUG:teuthology.orchestra.run.smithi150:> /usr/sbin/getenforce 2024-09-11T14:04:47.411 INFO:teuthology.orchestra.run.smithi150.stdout:Permissive 2024-09-11T14:04:47.411 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi150.front.sepia.ceph.com': 'permissive'} 2024-09-11T14:04:47.411 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T14:04:47.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:04:47.473 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T14:04:47.473 DEBUG:teuthology.orchestra.run.smithi150:> sudo /usr/sbin/setenforce permissive 2024-09-11T14:04:47.541 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T14:04:47.550 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T14:04:47.562 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T14:04:47.563 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi150.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T14:08:31.054 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi150.front.sepia.ceph.com')] 2024-09-11T14:08:31.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-11T14:08:31.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:08:31.132 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-11T14:08:31.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-11T14:08:31.220 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T14:08:31.233 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T14:08:31.233 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T14:08:31.234 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:08:31.289 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T14:08:31.303 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T14:08:31.328 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: ntpd: command not found 2024-09-11T14:08:31.338 INFO:teuthology.orchestra.run.smithi150.stdout:506 Cannot talk to daemon 2024-09-11T14:08:31.353 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T14:08:31.367 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T14:08:31.428 INFO:teuthology.orchestra.run.smithi150.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:08:31.432 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:08:31.432 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-09-11T14:08:31.432 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:08:31.432 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:08:31.432 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:08:31.432 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:08:31.433 INFO:teuthology.run_tasks:Running task install... 2024-09-11T14:08:31.445 DEBUG:teuthology.task.install:project ceph 2024-09-11T14:08:31.445 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab'}} 2024-09-11T14:08:31.445 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab'} 2024-09-11T14:08:31.445 INFO:teuthology.task.install:Using flavor: crimson 2024-09-11T14:08:31.451 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T14:08:31.451 INFO:teuthology.task.install:extra packages: [] 2024-09-11T14:08:31.451 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab', 'tag': None, 'wait_for_package': False} 2024-09-11T14:08:31.452 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=e7a65bf96d25c503998be3c193e951647cc62cab 2024-09-11T14:08:31.600 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/ 2024-09-11T14:08:31.600 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4884.ge7a65bf9 2024-09-11T14:08:31.715 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T14:08:31.715 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:08:31.715 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T14:08:31.742 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T14:08:31.742 DEBUG:teuthology.orchestra.run.smithi150:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e7a65bf96d25c503998be3c193e951647cc62cab/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T14:08:31.807 DEBUG:teuthology.orchestra.run.smithi150:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T14:08:31.882 DEBUG:teuthology.orchestra.run.smithi150:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T14:08:31.945 INFO:teuthology.orchestra.run.smithi150.stdout:check_obsoletes = 1 2024-09-11T14:08:31.947 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum clean all 2024-09-11T14:08:32.207 INFO:teuthology.orchestra.run.smithi150.stdout:45 files removed 2024-09-11T14:08:32.234 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-radosgw 2024-09-11T14:08:32.804 INFO:teuthology.orchestra.run.smithi150.stdout:ceph packages for x86_64 311 kB/s | 89 kB 00:00 2024-09-11T14:08:33.088 INFO:teuthology.orchestra.run.smithi150.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-11T14:08:33.364 INFO:teuthology.orchestra.run.smithi150.stdout:ceph source packages 8.7 kB/s | 2.1 kB 00:00 2024-09-11T14:08:36.097 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.2 MB 00:02 2024-09-11T14:08:45.498 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 20 MB 00:08 2024-09-11T14:08:50.073 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 6.5 MB 00:00 2024-09-11T14:08:51.733 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-11T14:08:52.630 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-11T14:08:58.153 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-11T14:09:00.547 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:09:00.559 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:09:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-09-11T14:09:00.559 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:09:00.559 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:09:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 10 M 2024-09-11T14:09:00.560 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2024-09-11T14:09:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 3.5 M 2024-09-11T14:09:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 3.8 M 2024-09-11T14:09:00.560 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-09-11T14:09:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T14:09:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 6.1 M 2024-09-11T14:09:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 20 M 2024-09-11T14:09:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 25 k 2024-09-11T14:09:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T14:09:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T14:09:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T14:09:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 808 k 2024-09-11T14:09:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T14:09:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T14:09:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T14:09:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T14:09:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 557 k 2024-09-11T14:09:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T14:09:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 5.4 M 2024-09-11T14:09:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T14:09:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T14:09:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T14:09:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 45 k 2024-09-11T14:09:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 143 k 2024-09-11T14:09:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 160 k 2024-09-11T14:09:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T14:09:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 315 k 2024-09-11T14:09:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 303 k 2024-09-11T14:09:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 99 k 2024-09-11T14:09:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T14:09:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T14:09:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T14:09:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T14:09:00.562 INFO:teuthology.orchestra.run.smithi150.stdout:Installing weak dependencies: 2024-09-11T14:09:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T14:09:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:09:00.562 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:09:00.562 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:09:00.563 INFO:teuthology.orchestra.run.smithi150.stdout:Install 31 Packages 2024-09-11T14:09:00.563 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 2 Packages 2024-09-11T14:09:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:09:00.563 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 60 M 2024-09-11T14:09:00.563 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:09:01.529 INFO:teuthology.orchestra.run.smithi150.stdout:(1/33): ceph-base-19.3.0-4884.ge7a65bf9.el9.x86 9.3 MB/s | 6.1 MB 00:00 2024-09-11T14:09:01.621 INFO:teuthology.orchestra.run.smithi150.stdout:(2/33): ceph-selinux-19.3.0-4884.ge7a65bf9.el9. 275 kB/s | 25 kB 00:00 2024-09-11T14:09:01.730 INFO:teuthology.orchestra.run.smithi150.stdout:(3/33): ceph-radosgw-19.3.0-4884.ge7a65bf9.el9. 12 MB/s | 10 MB 00:00 2024-09-11T14:09:01.764 INFO:teuthology.orchestra.run.smithi150.stdout:(4/33): libcephfs2-19.3.0-4884.ge7a65bf9.el9.x8 5.6 MB/s | 808 kB 00:00 2024-09-11T14:09:01.797 INFO:teuthology.orchestra.run.smithi150.stdout:(5/33): libradosstriper1-19.3.0-4884.ge7a65bf9. 8.2 MB/s | 557 kB 00:00 2024-09-11T14:09:01.847 INFO:teuthology.orchestra.run.smithi150.stdout:(6/33): python3-ceph-argparse-19.3.0-4884.ge7a6 899 kB/s | 45 kB 00:00 2024-09-11T14:09:01.923 INFO:teuthology.orchestra.run.smithi150.stdout:(7/33): python3-ceph-common-19.3.0-4884.ge7a65b 1.9 MB/s | 143 kB 00:00 2024-09-11T14:09:02.123 INFO:teuthology.orchestra.run.smithi150.stdout:(8/33): ceph-common-19.3.0-4884.ge7a65bf9.el9.x 16 MB/s | 20 MB 00:01 2024-09-11T14:09:02.148 INFO:teuthology.orchestra.run.smithi150.stdout:(9/33): python3-cephfs-19.3.0-4884.ge7a65bf9.el 710 kB/s | 160 kB 00:00 2024-09-11T14:09:02.173 INFO:teuthology.orchestra.run.smithi150.stdout:(10/33): python3-rados-19.3.0-4884.ge7a65bf9.el 6.2 MB/s | 315 kB 00:00 2024-09-11T14:09:02.207 INFO:teuthology.orchestra.run.smithi150.stdout:(11/33): python3-rbd-19.3.0-4884.ge7a65bf9.el9. 5.0 MB/s | 303 kB 00:00 2024-09-11T14:09:02.232 INFO:teuthology.orchestra.run.smithi150.stdout:(12/33): python3-rgw-19.3.0-4884.ge7a65bf9.el9. 1.7 MB/s | 99 kB 00:00 2024-09-11T14:09:02.324 INFO:teuthology.orchestra.run.smithi150.stdout:(13/33): librgw2-19.3.0-4884.ge7a65bf9.el9.x86_ 9.7 MB/s | 5.4 MB 00:00 2024-09-11T14:09:02.366 INFO:teuthology.orchestra.run.smithi150.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 673 kB/s | 107 kB 00:00 2024-09-11T14:09:02.417 INFO:teuthology.orchestra.run.smithi150.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-11T14:09:02.442 INFO:teuthology.orchestra.run.smithi150.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 815 kB/s | 171 kB 00:00 2024-09-11T14:09:02.476 INFO:teuthology.orchestra.run.smithi150.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-11T14:09:02.521 INFO:teuthology.orchestra.run.smithi150.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.6 MB/s | 292 kB 00:00 2024-09-11T14:09:02.551 INFO:teuthology.orchestra.run.smithi150.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-11T14:09:02.577 INFO:teuthology.orchestra.run.smithi150.stdout:(20/33): python3-prettytable-0.7.2-27.el9.noarc 419 kB/s | 42 kB 00:00 2024-09-11T14:09:02.602 INFO:teuthology.orchestra.run.smithi150.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 714 kB/s | 36 kB 00:00 2024-09-11T14:09:02.629 INFO:teuthology.orchestra.run.smithi150.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 941 kB/s | 47 kB 00:00 2024-09-11T14:09:02.652 INFO:teuthology.orchestra.run.smithi150.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-09-11T14:09:02.703 INFO:teuthology.orchestra.run.smithi150.stdout:(24/33): gperftools-libs-2.9.1-2.el9.x86_64.rpm 3.0 MB/s | 309 kB 00:00 2024-09-11T14:09:02.728 INFO:teuthology.orchestra.run.smithi150.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-11T14:09:02.753 INFO:teuthology.orchestra.run.smithi150.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 301 kB/s | 26 kB 00:00 2024-09-11T14:09:02.779 INFO:teuthology.orchestra.run.smithi150.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-11T14:09:02.812 INFO:teuthology.orchestra.run.smithi150.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T14:09:02.879 INFO:teuthology.orchestra.run.smithi150.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-11T14:09:02.921 INFO:teuthology.orchestra.run.smithi150.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-11T14:09:02.997 INFO:teuthology.orchestra.run.smithi150.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-11T14:09:03.105 INFO:teuthology.orchestra.run.smithi150.stdout:(32/33): librados2-19.3.0-4884.ge7a65bf9.el9.x8 15 MB/s | 3.5 MB 00:00 2024-09-11T14:09:03.197 INFO:teuthology.orchestra.run.smithi150.stdout:(33/33): librbd1-19.3.0-4884.ge7a65bf9.el9.x86_ 14 MB/s | 3.8 MB 00:00 2024-09-11T14:09:03.201 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:03.202 INFO:teuthology.orchestra.run.smithi150.stdout:Total 23 MB/s | 60 MB 00:02 2024-09-11T14:09:03.314 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:09:03.351 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:09:03.352 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:09:04.041 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:09:04.042 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:09:05.551 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:09:06.086 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-11T14:09:06.132 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/35 2024-09-11T14:09:06.224 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/35 2024-09-11T14:09:06.313 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 3/35 2024-09-11T14:09:06.342 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/35 2024-09-11T14:09:06.422 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/35 2024-09-11T14:09:06.483 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-11T14:09:06.522 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-11T14:09:06.547 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-11T14:09:06.569 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:09:06.596 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:09:06.739 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:09:06.769 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:09:06.804 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-11T14:09:06.848 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-argparse-2:19.3.0-4884.ge7a65bf9.el9. 11/35 2024-09-11T14:09:06.877 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 12/35 2024-09-11T14:09:06.955 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-11T14:09:06.983 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_6 14/35 2024-09-11T14:09:07.072 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_6 14/35 2024-09-11T14:09:07.107 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-11T14:09:07.224 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-11T14:09:07.266 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-11T14:09:07.307 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-11T14:09:07.340 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 19/35 2024-09-11T14:09:07.369 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-11T14:09:07.405 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-11T14:09:07.778 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-11T14:09:07.831 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 23/35 2024-09-11T14:09:07.931 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 23/35 2024-09-11T14:09:07.961 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 24/35 2024-09-11T14:09:07.997 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-11T14:09:08.600 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-11T14:09:08.634 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 27/35 2024-09-11T14:09:08.713 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 27/35 2024-09-11T14:09:08.792 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 28/35 2024-09-11T14:09:08.828 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x8 29/35 2024-09-11T14:09:11.285 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 30/35 2024-09-11T14:09:11.324 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 30/35 2024-09-11T14:09:12.031 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 30/35 2024-09-11T14:09:12.069 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 31/35 2024-09-11T14:09:12.161 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 31/35 2024-09-11T14:09:12.161 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T14:09:12.161 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T14:09:12.161 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:09:12.204 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 32/35 2024-09-11T14:09:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 32/35 2024-09-11T14:09:22.661 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /sys 2024-09-11T14:09:22.661 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /proc 2024-09-11T14:09:22.661 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /mnt 2024-09-11T14:09:22.661 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /var/tmp 2024-09-11T14:09:22.661 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /home 2024-09-11T14:09:22.661 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /root 2024-09-11T14:09:22.661 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /tmp 2024-09-11T14:09:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:09:23.753 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/35 2024-09-11T14:09:23.782 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/35 2024-09-11T14:09:23.782 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:09:23.782 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T14:09:23.782 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:09:23.782 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:09:23.782 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:09:23.784 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:09:23.871 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:09:23.871 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:09:25.264 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:09:25.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/35 2024-09-11T14:09:25.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/35 2024-09-11T14:09:25.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 3/35 2024-09-11T14:09:25.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/35 2024-09-11T14:09:25.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 5/35 2024-09-11T14:09:25.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_6 6/35 2024-09-11T14:09:25.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 7/35 2024-09-11T14:09:25.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4884.ge7a65bf9.el9. 8/35 2024-09-11T14:09:25.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x8 9/35 2024-09-11T14:09:25.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 10/35 2024-09-11T14:09:25.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 11/35 2024-09-11T14:09:25.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 12/35 2024-09-11T14:09:25.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 13/35 2024-09-11T14:09:25.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-11T14:09:25.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-11T14:09:25.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-11T14:09:25.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-11T14:09:25.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-11T14:09:25.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-11T14:09:25.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-11T14:09:25.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-11T14:09:25.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-11T14:09:25.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-11T14:09:25.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 24/35 2024-09-11T14:09:25.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-11T14:09:25.267 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-11T14:09:25.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-11T14:09:25.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-11T14:09:25.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-11T14:09:25.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-11T14:09:25.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-11T14:09:25.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 32/35 2024-09-11T14:09:25.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-11T14:09:25.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 34/35 2024-09-11T14:09:26.255 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:09:26.256 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:09:26.256 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2024-09-11T14:09:26.256 INFO:teuthology.orchestra.run.smithi150.stdout: librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:26.256 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:26.256 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:09:26.256 INFO:teuthology.orchestra.run.smithi150.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T14:09:26.256 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:26.256 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:26.256 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:26.257 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:26.257 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T14:09:26.257 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T14:09:26.257 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T14:09:26.257 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:26.257 INFO:teuthology.orchestra.run.smithi150.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T14:09:26.257 INFO:teuthology.orchestra.run.smithi150.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T14:09:26.257 INFO:teuthology.orchestra.run.smithi150.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T14:09:26.257 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T14:09:26.257 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:26.257 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T14:09:26.257 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:26.257 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T14:09:26.258 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T14:09:26.258 INFO:teuthology.orchestra.run.smithi150.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T14:09:26.258 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:26.258 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:26.258 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:26.258 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T14:09:26.258 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:26.258 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:26.258 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:26.258 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T14:09:26.258 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T14:09:26.258 INFO:teuthology.orchestra.run.smithi150.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T14:09:26.258 INFO:teuthology.orchestra.run.smithi150.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T14:09:26.258 INFO:teuthology.orchestra.run.smithi150.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T14:09:26.259 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:09:26.259 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:09:26.627 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-test 2024-09-11T14:09:27.185 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:00:29 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:09:27.319 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:09:27.320 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:09:27.320 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-09-11T14:09:27.320 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:09:27.320 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:09:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 85 M 2024-09-11T14:09:27.321 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-09-11T14:09:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-11T14:09:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 175 k 2024-09-11T14:09:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-11T14:09:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-11T14:09:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T14:09:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T14:09:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T14:09:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-11T14:09:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:09:27.323 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:09:27.323 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:09:27.323 INFO:teuthology.orchestra.run.smithi150.stdout:Install 9 Packages 2024-09-11T14:09:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:09:27.324 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 87 M 2024-09-11T14:09:27.324 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 797 M 2024-09-11T14:09:27.325 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:09:27.796 INFO:teuthology.orchestra.run.smithi150.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 658 kB/s | 94 kB 00:00 2024-09-11T14:09:27.888 INFO:teuthology.orchestra.run.smithi150.stdout:(2/9): libcephsqlite-19.3.0-4884.ge7a65bf9.el9. 745 kB/s | 175 kB 00:00 2024-09-11T14:09:29.005 INFO:teuthology.orchestra.run.smithi150.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 164 kB/s | 183 kB 00:01 2024-09-11T14:09:31.222 INFO:teuthology.orchestra.run.smithi150.stdout:(4/9): ceph-test-19.3.0-4884.ge7a65bf9.el9.x86_ 24 MB/s | 85 MB 00:03 2024-09-11T14:09:32.022 INFO:teuthology.orchestra.run.smithi150.stdout:(5/9): protobuf-3.14.0-13.el9.x86_64.rpm 342 kB/s | 1.0 MB 00:03 2024-09-11T14:09:33.222 INFO:teuthology.orchestra.run.smithi150.stdout:(6/9): socat-1.7.4.1-6.el9.x86_64.rpm 152 kB/s | 304 kB 00:01 2024-09-11T14:09:33.264 INFO:teuthology.orchestra.run.smithi150.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.9 MB/s | 122 kB 00:00 2024-09-11T14:09:34.139 INFO:teuthology.orchestra.run.smithi150.stdout:(8/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 30 kB/s | 64 kB 00:02 2024-09-11T14:09:35.997 INFO:teuthology.orchestra.run.smithi150.stdout:(9/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 63 kB/s | 513 kB 00:08 2024-09-11T14:09:36.001 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:36.001 INFO:teuthology.orchestra.run.smithi150.stdout:Total 10 MB/s | 87 MB 00:08 2024-09-11T14:09:36.084 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:09:36.107 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:09:36.107 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:09:36.707 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:09:36.707 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:09:37.607 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:09:37.685 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-11T14:09:37.732 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-11T14:09:37.776 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-11T14:09:37.820 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-11T14:09:37.859 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:09:37.886 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:09:37.953 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:09:38.001 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-11T14:09:38.028 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 8/9 2024-09-11T14:09:49.188 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 8/9 2024-09-11T14:09:49.267 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 9/9 2024-09-11T14:09:55.282 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 9/9 2024-09-11T14:09:55.282 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/9 2024-09-11T14:09:55.282 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/9 2024-09-11T14:09:55.282 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-11T14:09:55.282 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-11T14:09:55.283 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:09:55.283 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-11T14:09:55.283 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-11T14:09:55.283 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-11T14:09:55.728 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-11T14:09:55.729 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:09:55.729 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:09:55.729 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:55.729 INFO:teuthology.orchestra.run.smithi150.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-11T14:09:55.729 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:55.729 INFO:teuthology.orchestra.run.smithi150.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-11T14:09:55.729 INFO:teuthology.orchestra.run.smithi150.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-11T14:09:55.729 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T14:09:55.729 INFO:teuthology.orchestra.run.smithi150.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T14:09:55.730 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T14:09:55.730 INFO:teuthology.orchestra.run.smithi150.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-11T14:09:55.730 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:09:55.730 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:09:56.080 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph 2024-09-11T14:09:56.655 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:00:58 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:09:56.798 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:09:56.800 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:09:56.800 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-09-11T14:09:56.801 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:09:56.801 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:09:56.801 INFO:teuthology.orchestra.run.smithi150.stdout: ceph x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 6.5 k 2024-09-11T14:09:56.801 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-09-11T14:09:56.801 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 2.2 M 2024-09-11T14:09:56.801 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 1.6 M 2024-09-11T14:09:56.801 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 291 k 2024-09-11T14:09:56.801 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 5.1 M 2024-09-11T14:09:56.801 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 70 M 2024-09-11T14:09:56.801 INFO:teuthology.orchestra.run.smithi150.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T14:09:56.801 INFO:teuthology.orchestra.run.smithi150.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T14:09:56.801 INFO:teuthology.orchestra.run.smithi150.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T14:09:56.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T14:09:56.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T14:09:56.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T14:09:56.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T14:09:56.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T14:09:56.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T14:09:56.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T14:09:56.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-collections 2024-09-11T14:09:56.802 INFO:teuthology.orchestra.run.smithi150.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-11T14:09:56.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T14:09:56.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T14:09:56.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T14:09:56.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T14:09:56.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T14:09:56.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T14:09:56.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T14:09:56.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T14:09:56.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T14:09:56.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T14:09:56.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T14:09:56.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T14:09:56.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T14:09:56.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T14:09:56.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T14:09:56.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T14:09:56.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T14:09:56.804 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T14:09:56.804 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T14:09:56.804 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T14:09:56.804 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:09:56.804 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:09:56.804 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:09:56.804 INFO:teuthology.orchestra.run.smithi150.stdout:Install 37 Packages 2024-09-11T14:09:56.804 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:09:56.806 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 84 M 2024-09-11T14:09:56.806 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 896 M 2024-09-11T14:09:56.807 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:09:57.339 INFO:teuthology.orchestra.run.smithi150.stdout:(1/37): ceph-19.3.0-4884.ge7a65bf9.el9.x86_64.r 40 kB/s | 6.5 kB 00:00 2024-09-11T14:09:57.565 INFO:teuthology.orchestra.run.smithi150.stdout:(2/37): ceph-mds-19.3.0-4884.ge7a65bf9.el9.x86_ 5.6 MB/s | 2.2 MB 00:00 2024-09-11T14:09:57.607 INFO:teuthology.orchestra.run.smithi150.stdout:(3/37): ceph-mgr-19.3.0-4884.ge7a65bf9.el9.x86_ 3.7 MB/s | 1.6 MB 00:00 2024-09-11T14:09:57.682 INFO:teuthology.orchestra.run.smithi150.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4884.ge7a6 3.8 MB/s | 291 kB 00:00 2024-09-11T14:09:57.790 INFO:teuthology.orchestra.run.smithi150.stdout:(5/37): ceph-mon-19.3.0-4884.ge7a65bf9.el9.x86_ 11 MB/s | 5.1 MB 00:00 2024-09-11T14:09:57.866 INFO:teuthology.orchestra.run.smithi150.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-11T14:09:57.908 INFO:teuthology.orchestra.run.smithi150.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-11T14:09:57.951 INFO:teuthology.orchestra.run.smithi150.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-11T14:09:57.992 INFO:teuthology.orchestra.run.smithi150.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-09-11T14:09:58.034 INFO:teuthology.orchestra.run.smithi150.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 5.1 MB/s | 215 kB 00:00 2024-09-11T14:09:58.134 INFO:teuthology.orchestra.run.smithi150.stdout:(11/37): python3-cryptography-36.0.1-4.el9.x86_ 3.6 MB/s | 1.2 MB 00:00 2024-09-11T14:09:58.226 INFO:teuthology.orchestra.run.smithi150.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 981 kB/s | 188 kB 00:00 2024-09-11T14:09:58.268 INFO:teuthology.orchestra.run.smithi150.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 841 kB/s | 35 kB 00:00 2024-09-11T14:09:58.318 INFO:teuthology.orchestra.run.smithi150.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-11T14:09:58.344 INFO:teuthology.orchestra.run.smithi150.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 824 kB/s | 172 kB 00:00 2024-09-11T14:09:58.361 INFO:teuthology.orchestra.run.smithi150.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-11T14:09:58.394 INFO:teuthology.orchestra.run.smithi150.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-09-11T14:09:58.444 INFO:teuthology.orchestra.run.smithi150.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-11T14:09:58.470 INFO:teuthology.orchestra.run.smithi150.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-11T14:09:58.486 INFO:teuthology.orchestra.run.smithi150.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 177 kB/s | 22 kB 00:00 2024-09-11T14:09:58.520 INFO:teuthology.orchestra.run.smithi150.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-11T14:09:58.546 INFO:teuthology.orchestra.run.smithi150.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 601 kB/s | 11 kB 00:00 2024-09-11T14:09:58.571 INFO:teuthology.orchestra.run.smithi150.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 770 kB/s | 18 kB 00:00 2024-09-11T14:09:58.596 INFO:teuthology.orchestra.run.smithi150.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 927 kB/s | 23 kB 00:00 2024-09-11T14:09:58.621 INFO:teuthology.orchestra.run.smithi150.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 790 kB/s | 19 kB 00:00 2024-09-11T14:09:58.655 INFO:teuthology.orchestra.run.smithi150.stdout:(26/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.1 MB/s | 358 kB 00:00 2024-09-11T14:09:58.680 INFO:teuthology.orchestra.run.smithi150.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 336 kB/s | 20 kB 00:00 2024-09-11T14:09:58.706 INFO:teuthology.orchestra.run.smithi150.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-11T14:09:58.731 INFO:teuthology.orchestra.run.smithi150.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-11T14:09:58.756 INFO:teuthology.orchestra.run.smithi150.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 655 kB/s | 16 kB 00:00 2024-09-11T14:09:58.781 INFO:teuthology.orchestra.run.smithi150.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-11T14:09:58.807 INFO:teuthology.orchestra.run.smithi150.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-11T14:09:58.832 INFO:teuthology.orchestra.run.smithi150.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 710 kB/s | 36 kB 00:00 2024-09-11T14:09:58.866 INFO:teuthology.orchestra.run.smithi150.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2024-09-11T14:09:58.891 INFO:teuthology.orchestra.run.smithi150.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 802 kB/s | 20 kB 00:00 2024-09-11T14:09:58.925 INFO:teuthology.orchestra.run.smithi150.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.5 MB/s | 427 kB 00:00 2024-09-11T14:10:00.083 INFO:teuthology.orchestra.run.smithi150.stdout:(37/37): ceph-osd-19.3.0-4884.ge7a65bf9.el9.x86 28 MB/s | 70 MB 00:02 2024-09-11T14:10:00.087 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:10:00.087 INFO:teuthology.orchestra.run.smithi150.stdout:Total 26 MB/s | 84 MB 00:03 2024-09-11T14:10:00.230 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:10:00.272 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:10:00.272 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:10:01.095 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:10:01.095 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:10:02.745 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:10:02.811 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T14:10:02.843 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T14:10:02.872 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T14:10:02.943 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T14:10:02.987 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T14:10:03.020 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T14:10:03.113 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T14:10:03.189 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T14:10:03.239 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T14:10:03.275 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T14:10:03.304 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T14:10:03.340 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T14:10:03.372 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T14:10:03.422 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T14:10:03.465 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T14:10:03.499 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T14:10:03.548 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T14:10:03.580 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T14:10:03.652 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T14:10:03.818 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T14:10:03.897 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T14:10:03.958 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T14:10:03.996 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T14:10:04.053 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T14:10:04.108 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T14:10:04.304 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T14:10:04.350 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T14:10:04.427 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T14:10:04.516 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T14:10:04.549 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T14:10:04.686 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T14:10:04.877 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4884.ge7a65bf9.el9. 32/37 2024-09-11T14:10:04.909 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/37 2024-09-11T14:10:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/37 2024-09-11T14:10:04.936 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:10:04.936 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T14:10:04.936 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:10:04.936 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:10:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:15.459 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 34/37 2024-09-11T14:10:15.486 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 34/37 2024-09-11T14:10:15.487 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:10:15.487 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T14:10:15.487 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:10:15.487 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:10:15.487 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:16.027 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 35/37 2024-09-11T14:10:16.050 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 35/37 2024-09-11T14:10:16.050 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:10:16.050 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T14:10:16.050 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:10:16.050 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:10:16.050 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:16.286 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 36/37 2024-09-11T14:10:16.309 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 36/37 2024-09-11T14:10:16.309 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:10:16.309 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T14:10:16.309 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:10:16.309 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:10:16.309 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:16.373 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 37/37 2024-09-11T14:10:23.074 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 37/37 2024-09-11T14:10:23.074 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/37 2024-09-11T14:10:23.074 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/37 2024-09-11T14:10:23.074 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 3/37 2024-09-11T14:10:23.074 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/37 2024-09-11T14:10:23.074 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 5/37 2024-09-11T14:10:23.074 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4884.ge7a65bf9.el9. 6/37 2024-09-11T14:10:23.075 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T14:10:23.075 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T14:10:23.075 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T14:10:23.075 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T14:10:23.075 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T14:10:23.075 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T14:10:23.075 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T14:10:23.075 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T14:10:23.075 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T14:10:23.075 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T14:10:23.075 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T14:10:23.075 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T14:10:23.075 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T14:10:23.076 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T14:10:23.076 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T14:10:23.076 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T14:10:23.076 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T14:10:23.076 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T14:10:23.076 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T14:10:23.078 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T14:10:23.078 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T14:10:23.078 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T14:10:23.079 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T14:10:23.079 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T14:10:23.079 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T14:10:23.079 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T14:10:23.079 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T14:10:23.079 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T14:10:23.079 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T14:10:23.079 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T14:10:24.106 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T14:10:24.106 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:24.106 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:10:24.106 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:10:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:10:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:10:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:10:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:10:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:10:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T14:10:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T14:10:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T14:10:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T14:10:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T14:10:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T14:10:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T14:10:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T14:10:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T14:10:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T14:10:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T14:10:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T14:10:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T14:10:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T14:10:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T14:10:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T14:10:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T14:10:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T14:10:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T14:10:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T14:10:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T14:10:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T14:10:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T14:10:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T14:10:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T14:10:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T14:10:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T14:10:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T14:10:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T14:10:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T14:10:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T14:10:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:24.109 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:10:24.415 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-base 2024-09-11T14:10:25.001 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:27 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:10:25.096 INFO:teuthology.orchestra.run.smithi150.stdout:Package ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:10:25.140 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:10:25.141 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2024-09-11T14:10:25.141 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:10:25.208 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install cephadm 2024-09-11T14:10:25.789 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:27 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:10:25.922 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:10:25.923 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:10:25.923 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-09-11T14:10:25.923 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:10:25.923 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:10:25.923 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 784 k 2024-09-11T14:10:25.923 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:25.923 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:10:25.923 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:10:25.923 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2024-09-11T14:10:25.923 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:25.923 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 784 k 2024-09-11T14:10:25.924 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 791 k 2024-09-11T14:10:25.924 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:10:26.870 INFO:teuthology.orchestra.run.smithi150.stdout:cephadm-19.3.0-4884.ge7a65bf9.el9.noarch.rpm 830 kB/s | 784 kB 00:00 2024-09-11T14:10:26.870 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:10:26.870 INFO:teuthology.orchestra.run.smithi150.stdout:Total 828 kB/s | 784 kB 00:00 2024-09-11T14:10:26.871 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:10:26.876 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:10:26.876 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:10:26.882 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:10:26.883 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:10:26.960 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:10:27.459 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:10:27.550 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:10:27.924 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:10:28.196 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:10:28.197 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:28.197 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:10:28.197 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:10:28.197 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:28.197 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:10:28.399 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T14:10:28.976 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:30 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:10:29.111 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:10:29.112 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:10:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repo Size 2024-09-11T14:10:29.112 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:10:29.112 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:10:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 158 k 2024-09-11T14:10:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:29.112 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:10:29.112 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:10:29.112 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2024-09-11T14:10:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:29.112 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 158 k 2024-09-11T14:10:29.112 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 644 k 2024-09-11T14:10:29.113 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:10:29.320 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-immutable-object-cache-19.3.0-4884.ge7a65b 764 kB/s | 158 kB 00:00 2024-09-11T14:10:29.320 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:10:29.321 INFO:teuthology.orchestra.run.smithi150.stdout:Total 757 kB/s | 158 kB 00:00 2024-09-11T14:10:29.321 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:10:29.330 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:10:29.331 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:10:29.389 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:10:29.389 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:10:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:10:29.646 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9. 1/1 2024-09-11T14:10:29.671 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9. 1/1 2024-09-11T14:10:29.671 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:10:29.671 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T14:10:29.671 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:30.613 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9. 1/1 2024-09-11T14:10:30.613 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:30.613 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:10:30.613 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:10:30.613 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:30.613 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:10:30.873 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr 2024-09-11T14:10:31.440 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:33 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:10:31.536 INFO:teuthology.orchestra.run.smithi150.stdout:Package ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:10:31.579 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:10:31.580 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2024-09-11T14:10:31.580 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:10:31.647 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T14:10:32.209 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:34 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:10:32.342 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:10:32.343 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:10:32.343 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-09-11T14:10:32.343 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:10:32.343 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:10:32.343 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 14 M 2024-09-11T14:10:32.343 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-09-11T14:10:32.343 INFO:teuthology.orchestra.run.smithi150.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T14:10:32.344 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 34 k 2024-09-11T14:10:32.344 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 16 k 2024-09-11T14:10:32.344 INFO:teuthology.orchestra.run.smithi150.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T14:10:32.344 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T14:10:32.344 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T14:10:32.344 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T14:10:32.344 INFO:teuthology.orchestra.run.smithi150.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T14:10:32.344 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T14:10:32.344 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T14:10:32.344 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:32.344 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:10:32.344 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:10:32.344 INFO:teuthology.orchestra.run.smithi150.stdout:Install 11 Packages 2024-09-11T14:10:32.345 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:32.345 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 18 M 2024-09-11T14:10:32.345 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 155 M 2024-09-11T14:10:32.345 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:10:32.733 INFO:teuthology.orchestra.run.smithi150.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4884.ge7 139 kB/s | 34 kB 00:00 2024-09-11T14:10:32.766 INFO:teuthology.orchestra.run.smithi150.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4884.ge7a 59 kB/s | 16 kB 00:00 2024-09-11T14:10:32.942 INFO:teuthology.orchestra.run.smithi150.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 4.8 MB/s | 863 kB 00:00 2024-09-11T14:10:32.992 INFO:teuthology.orchestra.run.smithi150.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-11T14:10:33.017 INFO:teuthology.orchestra.run.smithi150.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-11T14:10:33.093 INFO:teuthology.orchestra.run.smithi150.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-11T14:10:33.118 INFO:teuthology.orchestra.run.smithi150.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-11T14:10:33.143 INFO:teuthology.orchestra.run.smithi150.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-11T14:10:33.168 INFO:teuthology.orchestra.run.smithi150.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-11T14:10:33.588 INFO:teuthology.orchestra.run.smithi150.stdout:(10/11): ceph-mgr-dashboard-19.3.0-4884.ge7a65b 13 MB/s | 14 MB 00:01 2024-09-11T14:10:33.702 INFO:teuthology.orchestra.run.smithi150.stdout:(11/11): python3-protobuf-3.14.0-13.el9.noarch. 278 kB/s | 269 kB 00:00 2024-09-11T14:10:33.706 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:10:33.706 INFO:teuthology.orchestra.run.smithi150.stdout:Total 13 MB/s | 18 MB 00:01 2024-09-11T14:10:33.737 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:10:33.755 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:10:33.755 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:10:34.030 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:10:34.031 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:10:34.578 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:10:34.658 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-11T14:10:34.688 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-11T14:10:34.786 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-11T14:10:34.915 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-11T14:10:34.959 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-11T14:10:35.043 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-11T14:10:35.094 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-11T14:10:35.123 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:10:35.155 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4884.ge7a65bf9.el9 9/11 2024-09-11T14:10:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4884.ge7a65bf9.el 10/11 2024-09-11T14:10:38.451 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noa 11/11 2024-09-11T14:10:40.166 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noa 11/11 2024-09-11T14:10:40.166 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4884.ge7a65bf9.el 1/11 2024-09-11T14:10:40.166 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noa 2/11 2024-09-11T14:10:40.167 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4884.ge7a65bf9.el9 3/11 2024-09-11T14:10:40.167 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-11T14:10:40.167 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-11T14:10:40.167 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-11T14:10:40.167 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-11T14:10:40.167 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:10:40.167 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-11T14:10:40.167 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-11T14:10:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-11T14:10:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:40.478 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:10:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T14:10:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:10:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:10:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:10:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T14:10:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T14:10:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T14:10:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T14:10:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T14:10:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T14:10:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T14:10:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:40.479 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:10:40.718 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T14:10:41.283 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:43 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:10:41.417 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:10:41.418 INFO:teuthology.orchestra.run.smithi150.stdout:======================================================================================= 2024-09-11T14:10:41.418 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-09-11T14:10:41.418 INFO:teuthology.orchestra.run.smithi150.stdout:======================================================================================= 2024-09-11T14:10:41.418 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:10:41.418 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 7.4 M 2024-09-11T14:10:41.418 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-09-11T14:10:41.418 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T14:10:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T14:10:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T14:10:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T14:10:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T14:10:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T14:10:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T14:10:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T14:10:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T14:10:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T14:10:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T14:10:41.419 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:41.419 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:10:41.419 INFO:teuthology.orchestra.run.smithi150.stdout:======================================================================================= 2024-09-11T14:10:41.420 INFO:teuthology.orchestra.run.smithi150.stdout:Install 12 Packages 2024-09-11T14:10:41.420 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:41.420 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 38 M 2024-09-11T14:10:41.420 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 212 M 2024-09-11T14:10:41.420 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:10:41.774 INFO:teuthology.orchestra.run.smithi150.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 891 kB/s | 191 kB 00:00 2024-09-11T14:10:41.883 INFO:teuthology.orchestra.run.smithi150.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-11T14:10:41.908 INFO:teuthology.orchestra.run.smithi150.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-09-11T14:10:41.983 INFO:teuthology.orchestra.run.smithi150.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 242 kB/s | 18 kB 00:00 2024-09-11T14:10:42.059 INFO:teuthology.orchestra.run.smithi150.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 512 kB/s | 38 kB 00:00 2024-09-11T14:10:42.717 INFO:teuthology.orchestra.run.smithi150.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.6 MB/s | 3.0 MB 00:00 2024-09-11T14:10:42.801 INFO:teuthology.orchestra.run.smithi150.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-11T14:10:43.026 INFO:teuthology.orchestra.run.smithi150.stdout:(8/12): ceph-mgr-diskprediction-local-19.3.0-48 5.0 MB/s | 7.4 MB 00:01 2024-09-11T14:10:43.201 INFO:teuthology.orchestra.run.smithi150.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 4.3 MB/s | 4.9 MB 00:01 2024-09-11T14:10:43.227 INFO:teuthology.orchestra.run.smithi150.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.2 MB/s | 250 kB 00:00 2024-09-11T14:10:44.060 INFO:teuthology.orchestra.run.smithi150.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.0 MB/s | 5.1 MB 00:01 2024-09-11T14:10:45.727 INFO:teuthology.orchestra.run.smithi150.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.4 MB/s | 16 MB 00:02 2024-09-11T14:10:45.727 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:10:45.728 INFO:teuthology.orchestra.run.smithi150.stdout:Total 8.9 MB/s | 38 MB 00:04 2024-09-11T14:10:46.080 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:10:46.106 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:10:46.107 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:10:46.539 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:10:46.539 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:10:47.304 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:10:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T14:10:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:10:47.517 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:10:47.559 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T14:10:47.744 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T14:10:47.783 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T14:10:47.859 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T14:10:48.509 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T14:10:48.621 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T14:10:49.876 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:10:50.902 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T14:10:50.933 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65 12/12 2024-09-11T14:10:53.611 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65 12/12 2024-09-11T14:10:53.611 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65 1/12 2024-09-11T14:10:53.612 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:10:53.612 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:10:53.612 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T14:10:53.612 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T14:10:53.612 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T14:10:53.612 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T14:10:53.612 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T14:10:53.612 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T14:10:53.612 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:10:53.612 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T14:10:54.065 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T14:10:54.065 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:54.065 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:10:54.066 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:10:54.066 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T14:10:54.066 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T14:10:54.066 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T14:10:54.066 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T14:10:54.066 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T14:10:54.066 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T14:10:54.066 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T14:10:54.066 INFO:teuthology.orchestra.run.smithi150.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T14:10:54.066 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T14:10:54.066 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T14:10:54.066 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T14:10:54.066 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:54.066 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:10:54.470 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr-rook 2024-09-11T14:10:55.061 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:57 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:10:55.204 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:10:55.205 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:10:55.205 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-09-11T14:10:55.205 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:10:55.205 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:10:55.205 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 49 k 2024-09-11T14:10:55.205 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-09-11T14:10:55.205 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T14:10:55.206 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T14:10:55.206 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T14:10:55.206 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T14:10:55.206 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T14:10:55.206 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T14:10:55.206 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T14:10:55.206 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T14:10:55.206 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T14:10:55.206 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T14:10:55.206 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T14:10:55.206 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T14:10:55.206 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:55.206 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:10:55.207 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:10:55.207 INFO:teuthology.orchestra.run.smithi150.stdout:Install 13 Packages 2024-09-11T14:10:55.207 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:10:55.207 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 2.2 M 2024-09-11T14:10:55.207 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 26 M 2024-09-11T14:10:55.207 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:10:55.874 INFO:teuthology.orchestra.run.smithi150.stdout:(1/13): ceph-mgr-rook-19.3.0-4884.ge7a65bf9.el9 292 kB/s | 49 kB 00:00 2024-09-11T14:10:56.007 INFO:teuthology.orchestra.run.smithi150.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 63 kB/s | 19 kB 00:00 2024-09-11T14:10:56.033 INFO:teuthology.orchestra.run.smithi150.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 78 kB/s | 26 kB 00:00 2024-09-11T14:10:56.392 INFO:teuthology.orchestra.run.smithi150.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 414 kB/s | 159 kB 00:00 2024-09-11T14:10:56.500 INFO:teuthology.orchestra.run.smithi150.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 597 kB/s | 279 kB 00:00 2024-09-11T14:10:56.525 INFO:teuthology.orchestra.run.smithi150.stdout:(6/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 341 kB/s | 222 kB 00:00 2024-09-11T14:10:56.550 INFO:teuthology.orchestra.run.smithi150.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 338 kB/s | 54 kB 00:00 2024-09-11T14:10:56.601 INFO:teuthology.orchestra.run.smithi150.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-11T14:10:56.626 INFO:teuthology.orchestra.run.smithi150.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-11T14:10:56.651 INFO:teuthology.orchestra.run.smithi150.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T14:10:56.676 INFO:teuthology.orchestra.run.smithi150.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-11T14:10:56.701 INFO:teuthology.orchestra.run.smithi150.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-11T14:10:56.735 INFO:teuthology.orchestra.run.smithi150.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-09-11T14:10:56.738 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:10:56.738 INFO:teuthology.orchestra.run.smithi150.stdout:Total 1.4 MB/s | 2.2 MB 00:01 2024-09-11T14:10:56.801 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:10:56.816 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:10:56.817 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:10:56.905 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:10:56.906 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:10:57.505 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:10:57.675 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T14:10:57.745 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T14:10:57.800 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T14:10:57.837 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T14:10:57.879 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T14:10:57.989 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T14:10:58.092 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T14:10:58.148 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T14:10:58.863 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T14:10:58.911 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T14:10:58.953 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T14:10:59.001 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T14:10:59.031 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 13/13 2024-09-11T14:10:59.780 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 13/13 2024-09-11T14:10:59.781 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/13 2024-09-11T14:10:59.781 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T14:10:59.781 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T14:10:59.781 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T14:10:59.781 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T14:10:59.781 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T14:10:59.781 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T14:10:59.781 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T14:10:59.781 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T14:10:59.781 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T14:10:59.781 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T14:10:59.781 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T14:11:00.113 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T14:11:00.113 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:00.113 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:11:00.113 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:11:00.113 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T14:11:00.113 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T14:11:00.113 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T14:11:00.113 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T14:11:00.113 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T14:11:00.113 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T14:11:00.114 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T14:11:00.114 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T14:11:00.114 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T14:11:00.114 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T14:11:00.114 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T14:11:00.114 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T14:11:00.114 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:00.114 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:00.366 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T14:11:00.928 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:02 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:11:01.062 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:11:01.063 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-09-11T14:11:01.063 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:01.063 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:11:01.063 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 154 k 2024-09-11T14:11:01.063 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-09-11T14:11:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T14:11:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T14:11:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T14:11:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T14:11:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T14:11:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:01.064 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:11:01.064 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:01.064 INFO:teuthology.orchestra.run.smithi150.stdout:Install 6 Packages 2024-09-11T14:11:01.064 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:01.065 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 7.0 M 2024-09-11T14:11:01.065 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 33 M 2024-09-11T14:11:01.065 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:11:01.412 INFO:teuthology.orchestra.run.smithi150.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.5 MB/s | 248 kB 00:00 2024-09-11T14:11:01.462 INFO:teuthology.orchestra.run.smithi150.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4884.ge7a65bf9.e 741 kB/s | 154 kB 00:00 2024-09-11T14:11:01.512 INFO:teuthology.orchestra.run.smithi150.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.3 MB/s | 548 kB 00:00 2024-09-11T14:11:01.537 INFO:teuthology.orchestra.run.smithi150.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 766 kB/s | 58 kB 00:00 2024-09-11T14:11:01.562 INFO:teuthology.orchestra.run.smithi150.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-11T14:11:01.655 INFO:teuthology.orchestra.run.smithi150.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-11T14:11:01.657 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:11:01.657 INFO:teuthology.orchestra.run.smithi150.stdout:Total 12 MB/s | 7.0 MB 00:00 2024-09-11T14:11:01.727 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:11:01.739 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:11:01.739 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:11:01.838 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:11:01.839 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:11:02.148 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:11:02.318 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T14:11:02.364 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T14:11:02.884 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T14:11:02.976 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T14:11:03.052 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T14:11:03.077 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 6/6 2024-09-11T14:11:03.893 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 6/6 2024-09-11T14:11:03.893 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/6 2024-09-11T14:11:03.893 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T14:11:03.893 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T14:11:03.893 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T14:11:03.893 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T14:11:04.175 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T14:11:04.175 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:04.175 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:11:04.176 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:11:04.176 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T14:11:04.176 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T14:11:04.176 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T14:11:04.176 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T14:11:04.176 INFO:teuthology.orchestra.run.smithi150.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T14:11:04.176 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:04.176 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:04.438 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-fuse 2024-09-11T14:11:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:07 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:11:05.138 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:11:05.139 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:05.139 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-09-11T14:11:05.139 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:05.139 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:11:05.139 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 883 k 2024-09-11T14:11:05.139 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-09-11T14:11:05.139 INFO:teuthology.orchestra.run.smithi150.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T14:11:05.139 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:05.139 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:11:05.139 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:05.139 INFO:teuthology.orchestra.run.smithi150.stdout:Install 2 Packages 2024-09-11T14:11:05.140 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:05.140 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 962 k 2024-09-11T14:11:05.140 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 4.1 M 2024-09-11T14:11:05.140 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:11:05.549 INFO:teuthology.orchestra.run.smithi150.stdout:(1/2): ceph-fuse-19.3.0-4884.ge7a65bf9.el9.x86_ 3.2 MB/s | 883 kB 00:00 2024-09-11T14:11:06.024 INFO:teuthology.orchestra.run.smithi150.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 107 kB/s | 80 kB 00:00 2024-09-11T14:11:06.025 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:11:06.025 INFO:teuthology.orchestra.run.smithi150.stdout:Total 1.1 MB/s | 962 kB 00:00 2024-09-11T14:11:06.037 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:11:06.061 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:11:06.061 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:11:06.141 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:11:06.141 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:11:06.326 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:11:06.486 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T14:11:06.565 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/2 2024-09-11T14:11:07.280 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/2 2024-09-11T14:11:07.280 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/2 2024-09-11T14:11:07.566 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T14:11:07.567 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:07.567 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:11:07.567 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T14:11:07.567 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:07.567 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:07.869 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-volume 2024-09-11T14:11:08.445 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:10 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:11:08.583 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:11:08.584 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:08.584 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-09-11T14:11:08.584 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:08.584 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:11:08.584 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 285 k 2024-09-11T14:11:08.584 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:08.584 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:11:08.584 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:08.584 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2024-09-11T14:11:08.585 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:08.585 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 285 k 2024-09-11T14:11:08.585 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 1.3 M 2024-09-11T14:11:08.585 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:11:08.986 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-volume-19.3.0-4884.ge7a65bf9.el9.noarch.rp 710 kB/s | 285 kB 00:00 2024-09-11T14:11:08.987 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:11:08.987 INFO:teuthology.orchestra.run.smithi150.stdout:Total 708 kB/s | 285 kB 00:00 2024-09-11T14:11:08.987 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:11:08.996 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:11:08.996 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:11:09.022 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:11:09.022 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:11:09.244 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:11:09.313 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:11:09.329 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:11:09.330 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:11:09.330 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T14:11:09.330 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:10.358 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:11:10.358 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:10.358 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:11:10.358 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:11:10.358 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:10.358 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:10.657 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install librados-devel 2024-09-11T14:11:11.235 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:13 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:11:11.371 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:11:11.372 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:11.372 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repo Size 2024-09-11T14:11:11.372 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:11.372 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:11:11.372 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 125 k 2024-09-11T14:11:11.372 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:11.373 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:11:11.373 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:11.373 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2024-09-11T14:11:11.373 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:11.373 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 125 k 2024-09-11T14:11:11.373 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 445 k 2024-09-11T14:11:11.373 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:11:11.583 INFO:teuthology.orchestra.run.smithi150.stdout:librados-devel-19.3.0-4884.ge7a65bf9.el9.x86_64 594 kB/s | 125 kB 00:00 2024-09-11T14:11:11.584 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:11:11.584 INFO:teuthology.orchestra.run.smithi150.stdout:Total 590 kB/s | 125 kB 00:00 2024-09-11T14:11:11.584 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:11:11.589 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:11:11.590 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:11:11.653 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:11:11.654 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:11:11.807 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:11:11.905 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:11:12.338 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:11:12.595 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:11:12.595 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:12.595 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:11:12.595 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:11:12.595 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:12.595 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:12.816 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install libcephfs2 2024-09-11T14:11:13.399 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:15 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:11:13.493 INFO:teuthology.orchestra.run.smithi150.stdout:Package libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:11:13.538 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:11:13.540 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2024-09-11T14:11:13.540 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:13.616 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install libcephfs-devel 2024-09-11T14:11:14.189 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:16 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:11:14.319 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:11:14.320 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:14.320 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repo Size 2024-09-11T14:11:14.320 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:14.320 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:11:14.320 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 32 k 2024-09-11T14:11:14.321 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:14.321 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:11:14.321 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:14.321 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2024-09-11T14:11:14.321 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:14.321 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 32 k 2024-09-11T14:11:14.321 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 142 k 2024-09-11T14:11:14.321 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:11:14.486 INFO:teuthology.orchestra.run.smithi150.stdout:libcephfs-devel-19.3.0-4884.ge7a65bf9.el9.x86_6 192 kB/s | 32 kB 00:00 2024-09-11T14:11:14.487 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:11:14.487 INFO:teuthology.orchestra.run.smithi150.stdout:Total 191 kB/s | 32 kB 00:00 2024-09-11T14:11:14.487 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:11:14.490 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:11:14.490 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:11:14.513 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:11:14.513 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:11:14.604 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:11:14.716 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:11:15.092 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:11:15.323 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:11:15.323 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:15.323 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:11:15.323 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:11:15.323 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:15.324 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:15.508 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install librados2 2024-09-11T14:11:16.070 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:18 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:11:16.161 INFO:teuthology.orchestra.run.smithi150.stdout:Package librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:11:16.205 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:11:16.206 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2024-09-11T14:11:16.206 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:16.270 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install librbd1 2024-09-11T14:11:16.829 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:18 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:11:16.919 INFO:teuthology.orchestra.run.smithi150.stdout:Package librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:11:16.963 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:11:16.965 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2024-09-11T14:11:16.966 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:17.021 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install python3-rados 2024-09-11T14:11:17.585 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:19 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:11:17.676 INFO:teuthology.orchestra.run.smithi150.stdout:Package python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:11:17.720 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:11:17.721 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2024-09-11T14:11:17.721 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:17.785 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install python3-rgw 2024-09-11T14:11:18.357 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:20 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:11:18.448 INFO:teuthology.orchestra.run.smithi150.stdout:Package python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:11:18.491 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:11:18.492 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2024-09-11T14:11:18.492 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:18.555 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install python3-cephfs 2024-09-11T14:11:19.116 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:21 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:11:19.207 INFO:teuthology.orchestra.run.smithi150.stdout:Package python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:11:19.251 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:11:19.252 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2024-09-11T14:11:19.252 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:19.316 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install python3-rbd 2024-09-11T14:11:19.877 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:21 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:11:19.968 INFO:teuthology.orchestra.run.smithi150.stdout:Package python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:11:20.011 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:11:20.012 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2024-09-11T14:11:20.013 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:20.074 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install rbd-fuse 2024-09-11T14:11:20.636 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:22 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:11:20.768 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:11:20.769 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:20.769 INFO:teuthology.orchestra.run.smithi150.stdout: Package Architecture Version Repository Size 2024-09-11T14:11:20.769 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:20.769 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:11:20.769 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 91 k 2024-09-11T14:11:20.769 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:20.769 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:11:20.769 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:20.770 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2024-09-11T14:11:20.770 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:20.770 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 91 k 2024-09-11T14:11:20.770 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 321 k 2024-09-11T14:11:20.770 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:11:21.014 INFO:teuthology.orchestra.run.smithi150.stdout:rbd-fuse-19.3.0-4884.ge7a65bf9.el9.x86_64.rpm 372 kB/s | 91 kB 00:00 2024-09-11T14:11:21.015 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:11:21.015 INFO:teuthology.orchestra.run.smithi150.stdout:Total 370 kB/s | 91 kB 00:00 2024-09-11T14:11:21.015 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:11:21.023 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:11:21.024 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:11:21.088 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:11:21.089 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:11:21.235 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:11:21.356 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:11:21.721 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:11:22.024 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:11:22.024 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:22.024 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:11:22.024 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:11:22.024 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:22.024 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:22.258 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install rbd-mirror 2024-09-11T14:11:22.823 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:24 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:11:22.957 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:11:22.958 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:22.958 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repo Size 2024-09-11T14:11:22.958 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:22.958 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:11:22.958 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 3.5 M 2024-09-11T14:11:22.958 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:22.959 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:11:22.959 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:22.959 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2024-09-11T14:11:22.959 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:22.959 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 3.5 M 2024-09-11T14:11:22.959 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 30 M 2024-09-11T14:11:22.959 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:11:23.426 INFO:teuthology.orchestra.run.smithi150.stdout:rbd-mirror-19.3.0-4884.ge7a65bf9.el9.x86_64.rpm 7.5 MB/s | 3.5 MB 00:00 2024-09-11T14:11:23.426 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:11:23.427 INFO:teuthology.orchestra.run.smithi150.stdout:Total 7.5 MB/s | 3.5 MB 00:00 2024-09-11T14:11:23.427 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:11:23.438 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:11:23.438 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:11:23.521 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:11:23.521 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:11:24.120 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:11:24.185 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:11:24.210 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:11:24.210 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:11:24.210 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T14:11:24.210 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:11:24.210 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:11:24.210 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:25.494 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:11:25.495 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:25.495 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:11:25.495 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:11:25.495 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:25.495 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:25.761 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install rbd-nbd 2024-09-11T14:11:26.338 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:28 ago on Wed 11 Sep 2024 02:08:58 PM UTC. 2024-09-11T14:11:26.474 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-11T14:11:26.475 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:26.475 INFO:teuthology.orchestra.run.smithi150.stdout: Package Architecture Version Repository Size 2024-09-11T14:11:26.475 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:26.476 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-11T14:11:26.476 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 177 k 2024-09-11T14:11:26.476 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:26.476 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-11T14:11:26.476 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-11T14:11:26.476 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2024-09-11T14:11:26.476 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:26.476 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 177 k 2024-09-11T14:11:26.476 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 685 k 2024-09-11T14:11:26.476 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-11T14:11:26.739 INFO:teuthology.orchestra.run.smithi150.stdout:rbd-nbd-19.3.0-4884.ge7a65bf9.el9.x86_64.rpm 674 kB/s | 177 kB 00:00 2024-09-11T14:11:26.740 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:11:26.740 INFO:teuthology.orchestra.run.smithi150.stdout:Total 670 kB/s | 177 kB 00:00 2024-09-11T14:11:26.740 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-11T14:11:26.749 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-11T14:11:26.750 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-11T14:11:26.812 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-11T14:11:26.813 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-11T14:11:26.970 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-11T14:11:27.077 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:11:27.541 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:11:27.831 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:11:27.831 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:27.831 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-11T14:11:27.831 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:11:27.831 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:27.831 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-11T14:11:28.101 DEBUG:teuthology.parallel:result is None 2024-09-11T14:11:28.102 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=e7a65bf96d25c503998be3c193e951647cc62cab 2024-09-11T14:11:28.259 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T14:11:28.281 INFO:teuthology.orchestra.run.smithi150.stdout:19.3.0-4884.ge7a65bf9.el9 2024-09-11T14:11:28.281 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4884.ge7a65bf9.el9 2024-09-11T14:11:28.281 INFO:teuthology.task.install:The correct ceph version 19.3.0-4884.ge7a65bf9 is installed. 2024-09-11T14:11:28.283 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T14:11:28.283 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:28.284 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T14:11:28.349 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T14:11:28.350 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:28.350 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T14:11:28.413 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T14:11:28.478 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T14:11:28.478 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:28.478 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T14:11:28.543 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T14:11:28.608 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T14:11:28.609 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:28.609 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T14:11:28.673 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T14:11:28.741 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T14:11:28.829 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T14:11:28.829 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2024-09-11T14:11:28.854 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T14:11:28.855 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T14:11:28.919 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T14:11:28.920 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T14:11:28.993 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T14:11:28.994 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T14:11:28.994 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901312', 'branch': 'wip-matanb-crimson-testing-sep11', 'description': 'crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rbd_api_tests_old_format}', 'email': None, 'first_in_suite': False, 'job_id': '7901312', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-sep11'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 2853, 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi150.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPpAKMPo9OB72V6/hSoqFlGlXcGAW826jG86Gt/dyA6N38/6TvXltM3S72e1XHFC+O/zBrrAuJCaWYSs857XVMI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rbd/crimson/test_crimson_librbd.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_13:53:46', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T14:11:28.994 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T14:11:29.041 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T14:11:29.106 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:29.106 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T14:11:29.163 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T14:11:29.163 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2024-09-11T14:11:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T14:11:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:11:29.220 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-11T14:11:29.220 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:11:29.220 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:11:29.220 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-11 14:11:24.471130837 +0000 2024-09-11T14:11:29.220 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-11 14:08:10.958122103 +0000 2024-09-11T14:11:29.220 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-11 14:08:10.958122103 +0000 2024-09-11T14:11:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-11 14:08:10.958122103 +0000 2024-09-11T14:11:29.221 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T14:11:29.283 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-11T14:11:29.283 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-11T14:11:29.283 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.00020884 s, 2.5 MB/s 2024-09-11T14:11:29.284 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T14:11:29.341 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2024-09-11T14:11:29.396 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T14:11:29.396 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:11:29.396 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-11T14:11:29.396 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:11:29.396 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:11:29.396 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-11 14:11:24.472130816 +0000 2024-09-11T14:11:29.397 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-11 14:08:11.290115356 +0000 2024-09-11T14:11:29.397 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-11 14:08:11.290115356 +0000 2024-09-11T14:11:29.397 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-11 14:08:11.290115356 +0000 2024-09-11T14:11:29.397 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T14:11:29.459 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-11T14:11:29.460 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-11T14:11:29.460 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000190278 s, 2.7 MB/s 2024-09-11T14:11:29.461 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T14:11:29.516 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2024-09-11T14:11:29.572 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T14:11:29.572 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:11:29.572 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-11T14:11:29.572 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:11:29.572 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:11:29.573 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-11 14:11:24.472130816 +0000 2024-09-11T14:11:29.573 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-11 14:08:11.608108893 +0000 2024-09-11T14:11:29.573 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-11 14:08:11.608108893 +0000 2024-09-11T14:11:29.573 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-11 14:08:11.608108893 +0000 2024-09-11T14:11:29.573 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T14:11:29.635 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-11T14:11:29.636 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-11T14:11:29.636 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000203981 s, 2.5 MB/s 2024-09-11T14:11:29.637 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T14:11:29.693 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2024-09-11T14:11:29.748 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T14:11:29.748 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:11:29.748 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-11T14:11:29.748 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:11:29.749 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:11:29.749 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-11 14:11:24.473130796 +0000 2024-09-11T14:11:29.749 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-11 14:08:11.938102187 +0000 2024-09-11T14:11:29.749 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-11 14:08:11.938102187 +0000 2024-09-11T14:11:29.749 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-11 14:08:11.938102187 +0000 2024-09-11T14:11:29.749 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T14:11:29.813 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-11T14:11:29.814 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-11T14:11:29.814 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000187272 s, 2.7 MB/s 2024-09-11T14:11:29.815 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T14:11:29.871 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-11T14:11:29.871 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-11T14:11:29.871 INFO:tasks.ceph:Generating config... 2024-09-11T14:11:29.872 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-11T14:11:29.872 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-11T14:11:29.872 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-11T14:11:29.872 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-11T14:11:29.872 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-11T14:11:29.872 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T14:11:29.873 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T14:11:29.873 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T14:11:29.873 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-11T14:11:29.873 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-11T14:11:29.873 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-11T14:11:29.873 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-11T14:11:29.873 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T14:11:29.873 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T14:11:29.873 INFO:tasks.ceph:[osd] osd objectstore = seastore 2024-09-11T14:11:29.873 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-11T14:11:29.873 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-11T14:11:29.873 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-11T14:11:29.873 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-11T14:11:29.874 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-11T14:11:29.874 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-11T14:11:29.874 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-11T14:11:29.874 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-11T14:11:29.874 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T14:11:29.874 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T14:11:29.874 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-11T14:11:29.874 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-1 2024-09-11T14:11:29.874 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 2-3 2024-09-11T14:11:29.874 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 4-5 2024-09-11T14:11:29.874 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T14:11:29.875 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T14:11:29.971 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T14:11:29.974 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T14:11:30.025 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T14:11:30.049 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.150')] 2024-09-11T14:11:30.049 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.150', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}} 2024-09-11T14:11:30.050 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:30.050 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T14:11:30.105 DEBUG:teuthology.orchestra.run.smithi150:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.150 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:11:30.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:30.195+0000 7fdf7723bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:30.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:30.195+0000 7fdf7723bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:30.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:30.196+0000 7fdf7723bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:30.197 INFO:teuthology.orchestra.run.smithi150.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:11:30.197 INFO:teuthology.orchestra.run.smithi150.stdout:monmaptool: generated fsid 460d6576-fe4d-4af0-a3e1-de2d64971e7b 2024-09-11T14:11:30.197 INFO:teuthology.orchestra.run.smithi150.stdout:setting min_mon_release = quincy 2024-09-11T14:11:30.198 INFO:teuthology.orchestra.run.smithi150.stdout:epoch 0 2024-09-11T14:11:30.198 INFO:teuthology.orchestra.run.smithi150.stdout:fsid 460d6576-fe4d-4af0-a3e1-de2d64971e7b 2024-09-11T14:11:30.198 INFO:teuthology.orchestra.run.smithi150.stdout:last_changed 2024-09-11T14:11:30.196757+0000 2024-09-11T14:11:30.198 INFO:teuthology.orchestra.run.smithi150.stdout:created 2024-09-11T14:11:30.196757+0000 2024-09-11T14:11:30.198 INFO:teuthology.orchestra.run.smithi150.stdout:min_mon_release 17 (quincy) 2024-09-11T14:11:30.198 INFO:teuthology.orchestra.run.smithi150.stdout:election_strategy: 1 2024-09-11T14:11:30.198 INFO:teuthology.orchestra.run.smithi150.stdout:0: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.a 2024-09-11T14:11:30.198 INFO:teuthology.orchestra.run.smithi150.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-11T14:11:30.199 DEBUG:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T14:11:30.214 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 460d6576-fe4d-4af0-a3e1-de2d64971e7b... 2024-09-11T14:11:30.215 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T14:11:30.298 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2024-09-11T14:11:30.298 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2024-09-11T14:11:30.298 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T14:11:30.298 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2024-09-11T14:11:30.298 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.298 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2024-09-11T14:11:30.298 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.298 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2024-09-11T14:11:30.298 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.298 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2024-09-11T14:11:30.298 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2024-09-11T14:11:30.299 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.299 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2024-09-11T14:11:30.299 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2024-09-11T14:11:30.299 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.299 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T14:11:30.299 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2024-09-11T14:11:30.299 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.299 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T14:11:30.299 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T14:11:30.299 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.299 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2024-09-11T14:11:30.299 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.299 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2024-09-11T14:11:30.299 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2024-09-11T14:11:30.300 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2024-09-11T14:11:30.300 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2024-09-11T14:11:30.300 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2024-09-11T14:11:30.300 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2024-09-11T14:11:30.300 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2024-09-11T14:11:30.300 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T14:11:30.300 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T14:11:30.300 INFO:teuthology.orchestra.run.smithi150.stdout: mon_allow_pool_size_one = true 2024-09-11T14:11:30.300 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.300 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T14:11:30.300 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.300 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2024-09-11T14:11:30.300 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.301 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2024-09-11T14:11:30.301 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.301 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2024-09-11T14:11:30.301 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2024-09-11T14:11:30.301 INFO:teuthology.orchestra.run.smithi150.stdout: mon health detail to clog = false 2024-09-11T14:11:30.301 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = 172.21.15.150 2024-09-11T14:11:30.301 INFO:teuthology.orchestra.run.smithi150.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-11T14:11:30.301 INFO:teuthology.orchestra.run.smithi150.stdout: ms client mode = crc 2024-09-11T14:11:30.301 INFO:teuthology.orchestra.run.smithi150.stdout: ms cluster mode = crc 2024-09-11T14:11:30.301 INFO:teuthology.orchestra.run.smithi150.stdout: ms mon client mode = crc 2024-09-11T14:11:30.301 INFO:teuthology.orchestra.run.smithi150.stdout: ms mon cluster mode = crc 2024-09-11T14:11:30.301 INFO:teuthology.orchestra.run.smithi150.stdout: ms mon service mode = crc 2024-09-11T14:11:30.301 INFO:teuthology.orchestra.run.smithi150.stdout: ms service mode = crc 2024-09-11T14:11:30.301 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = 460d6576-fe4d-4af0-a3e1-de2d64971e7b 2024-09-11T14:11:30.302 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.302 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2024-09-11T14:11:30.302 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2024-09-11T14:11:30.302 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.302 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2024-09-11T14:11:30.302 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2024-09-11T14:11:30.302 INFO:teuthology.orchestra.run.smithi150.stdout: osd mclock profile = high_recovery_ops 2024-09-11T14:11:30.302 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.302 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2024-09-11T14:11:30.302 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2024-09-11T14:11:30.303 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.303 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2024-09-11T14:11:30.303 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2024-09-11T14:11:30.303 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2024-09-11T14:11:30.303 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug trim objects = true 2024-09-11T14:11:30.303 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.303 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2024-09-11T14:11:30.303 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2024-09-11T14:11:30.303 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.303 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2024-09-11T14:11:30.303 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.303 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2024-09-11T14:11:30.303 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.304 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2024-09-11T14:11:30.304 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.304 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2024-09-11T14:11:30.304 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2024-09-11T14:11:30.304 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.304 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2024-09-11T14:11:30.304 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2024-09-11T14:11:30.304 INFO:teuthology.orchestra.run.smithi150.stdout: debug monc = 20 2024-09-11T14:11:30.304 INFO:teuthology.orchestra.run.smithi150.stdout: crimson alien thread cpu cores = 6-7 2024-09-11T14:11:30.304 INFO:teuthology.orchestra.run.smithi150.stdout: crimson osd obc lru size = 10 2024-09-11T14:11:30.304 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-11T14:11:30.304 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 20 2024-09-11T14:11:30.304 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = seastore 2024-09-11T14:11:30.304 INFO:teuthology.orchestra.run.smithi150.stdout: osd shutdown pgref assert = True 2024-09-11T14:11:30.305 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.305 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2024-09-11T14:11:30.305 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-11T14:11:30.305 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2024-09-11T14:11:30.305 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-09-11T14:11:30.305 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-09-11T14:11:30.305 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:11:30.305 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:11:30.305 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2024-09-11T14:11:30.305 INFO:teuthology.orchestra.run.smithi150.stdout: mgr stats period = 30 2024-09-11T14:11:30.305 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.305 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2024-09-11T14:11:30.305 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-11T14:11:30.305 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-09-11T14:11:30.306 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2024-09-11T14:11:30.306 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-09-11T14:11:30.306 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2024-09-11T14:11:30.306 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2024-09-11T14:11:30.306 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:11:30.306 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2024-09-11T14:11:30.306 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2024-09-11T14:11:30.306 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:11:30.306 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.306 INFO:teuthology.orchestra.run.smithi150.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T14:11:30.306 INFO:teuthology.orchestra.run.smithi150.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T14:11:30.306 INFO:teuthology.orchestra.run.smithi150.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T14:11:30.306 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.306 INFO:teuthology.orchestra.run.smithi150.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T14:11:30.307 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T14:11:30.307 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T14:11:30.307 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.307 INFO:teuthology.orchestra.run.smithi150.stdout: # 1m isn't quite enough 2024-09-11T14:11:30.307 INFO:teuthology.orchestra.run.smithi150.stdout: mon_down_mkfs_grace = 2m 2024-09-11T14:11:30.307 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.307 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_filestore_osds = false 2024-09-11T14:11:30.307 INFO:teuthology.orchestra.run.smithi150.stdout: mon min osdmap epochs = 50 2024-09-11T14:11:30.307 INFO:teuthology.orchestra.run.smithi150.stdout: mon osdmap full prune interval = 2 2024-09-11T14:11:30.307 INFO:teuthology.orchestra.run.smithi150.stdout: mon osdmap full prune min = 15 2024-09-11T14:11:30.307 INFO:teuthology.orchestra.run.smithi150.stdout: mon osdmap full prune txsize = 2 2024-09-11T14:11:30.307 INFO:teuthology.orchestra.run.smithi150.stdout: paxos service trim min = 10 2024-09-11T14:11:30.307 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default crimson = True 2024-09-11T14:11:30.307 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:30.307 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2024-09-11T14:11:30.308 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2024-09-11T14:11:30.308 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = true 2024-09-11T14:11:30.308 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2024-09-11T14:11:30.308 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T14:11:30.308 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T14:11:30.308 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2024-09-11T14:11:30.308 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2024-09-11T14:11:30.308 INFO:teuthology.orchestra.run.smithi150.stdout: crimson seastar cpu cores = 0-1 2024-09-11T14:11:30.308 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2024-09-11T14:11:30.308 INFO:teuthology.orchestra.run.smithi150.stdout: crimson seastar cpu cores = 2-3 2024-09-11T14:11:30.308 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2024-09-11T14:11:30.309 INFO:teuthology.orchestra.run.smithi150.stdout: crimson seastar cpu cores = 4-5 2024-09-11T14:11:30.309 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T14:11:30.310 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T14:11:30.415 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T14:11:30.415 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:30.416 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T14:11:30.431 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:30.431 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T14:11:30.486 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2024-09-11T14:11:30.486 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:30.486 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T14:11:30.486 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T14:11:30.560 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:30.561 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:11:30.616 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T14:11:30.616 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T14:11:30.616 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T14:11:30.716 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T14:11:30.719 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T14:11:30.719 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T14:11:30.719 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T14:11:30.769 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T14:11:30.785 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T14:11:30.785 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-11T14:11:30.786 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T14:11:30.810 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-11T14:11:30.810 INFO:tasks.ceph:role: osd.0 2024-09-11T14:11:30.810 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-11T14:11:30.810 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T14:11:30.882 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:11:30.882 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:11:30.882 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:11:30.882 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:11:30.882 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:11:30.882 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:11:30.882 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:11:30.883 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:11:30.883 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:11:30.883 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:11:31.390 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-11T14:11:31.392 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-11T14:11:31.392 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T14:11:31.525 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T14:11:31.560 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T14:11:31.627 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-11T14:11:31.627 INFO:tasks.ceph:role: osd.1 2024-09-11T14:11:31.627 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-11T14:11:31.627 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T14:11:31.700 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:11:31.701 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:11:31.701 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:11:31.701 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:11:31.701 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:11:31.701 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:11:31.701 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:11:31.701 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:11:31.701 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:11:31.701 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:11:32.160 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-11T14:11:32.162 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-11T14:11:32.162 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T14:11:32.255 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T14:11:32.286 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T14:11:32.353 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-11T14:11:32.353 INFO:tasks.ceph:role: osd.2 2024-09-11T14:11:32.353 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-11T14:11:32.353 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T14:11:32.426 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:11:32.427 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:11:32.427 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:11:32.427 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:11:32.427 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:11:32.427 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:11:32.427 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:11:32.427 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:11:32.427 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:11:32.427 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:11:32.917 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-11T14:11:32.919 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-11T14:11:32.919 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-11T14:11:33.063 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T14:11:33.097 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:11:33.402 INFO:teuthology.orchestra.run.smithi150.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:11:33.402 INFO:teuthology.orchestra.run.smithi150.stderr:INFO 2024-09-11 14:11:33,402 seastar - Reactor backend: linux-aio 2024-09-11T14:11:33.414 INFO:teuthology.orchestra.run.smithi150.stderr:==27775==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:11:33.529 INFO:teuthology.orchestra.run.smithi150.stderr:INFO 2024-09-11 14:11:33,528 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:11:33.529 INFO:teuthology.orchestra.run.smithi150.stderr:INFO 2024-09-11 14:11:33,528 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-1 2024-09-11T14:11:33.529 INFO:teuthology.orchestra.run.smithi150.stderr:DEBUG 2024-09-11 14:11:33,529 [shard 0:main] seastar - reactor::drain 2024-09-11T14:11:34.035 INFO:teuthology.orchestra.run.smithi150.stderr:----------------------------------------------------- 2024-09-11T14:11:34.035 INFO:teuthology.orchestra.run.smithi150.stderr:Suppressions used: 2024-09-11T14:11:34.035 INFO:teuthology.orchestra.run.smithi150.stderr: count bytes template 2024-09-11T14:11:34.035 INFO:teuthology.orchestra.run.smithi150.stderr: 1 8 MallocExtension::Register 2024-09-11T14:11:34.035 INFO:teuthology.orchestra.run.smithi150.stderr:----------------------------------------------------- 2024-09-11T14:11:34.035 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-11T14:11:34.092 INFO:teuthology.orchestra.run.smithi150.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:11:34.096 INFO:teuthology.orchestra.run.smithi150.stderr:INFO 2024-09-11 14:11:34,096 seastar - Reactor backend: linux-aio 2024-09-11T14:11:34.104 INFO:teuthology.orchestra.run.smithi150.stderr:==27773==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:11:34.388 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xdd323 0x4ab1c 0xb9da634 0xb9e7d2d 0xba16daf 0xba173f9 0xb9b1fad 0x9826801 0x9adc9e4 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:11:34.388 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:34.445 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x99c1417 0x99c1700 0x99f995a 0x99f9c0a 0x992959d 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:11:34.446 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:34.615 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x8b57d 0x10d76c 0xdd31a 0x4ab1c 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:34.615 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:34.672 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x5525495 0x9e169de 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:34.672 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:34.694 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x55252ba 0x9e169c9 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:11:34.694 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:34.752 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x9e169b8 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:11:34.752 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:34.780 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x133d18 0xdd332 0x4ab1c 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:34.780 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:34.859 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xdd332 0x4ab1c 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:11:34.860 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:35.263 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x133d18 0xdd332 0x4ab1c 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:35.263 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:35.321 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x10798d 0xdd2fc 0x4ab1c 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:35.321 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:36.279 INFO:teuthology.orchestra.run.smithi150.stderr:----------------------------------------------------- 2024-09-11T14:11:36.279 INFO:teuthology.orchestra.run.smithi150.stderr:Suppressions used: 2024-09-11T14:11:36.280 INFO:teuthology.orchestra.run.smithi150.stderr: count bytes template 2024-09-11T14:11:36.280 INFO:teuthology.orchestra.run.smithi150.stderr: 1 8 MallocExtension::Register 2024-09-11T14:11:36.280 INFO:teuthology.orchestra.run.smithi150.stderr:----------------------------------------------------- 2024-09-11T14:11:36.280 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-11T14:11:36.310 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T14:11:36.335 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:11:36.613 INFO:teuthology.orchestra.run.smithi150.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:11:36.614 INFO:teuthology.orchestra.run.smithi150.stderr:INFO 2024-09-11 14:11:36,613 seastar - Reactor backend: linux-aio 2024-09-11T14:11:36.620 INFO:teuthology.orchestra.run.smithi150.stderr:==27820==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:11:36.737 INFO:teuthology.orchestra.run.smithi150.stderr:INFO 2024-09-11 14:11:36,736 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:11:36.737 INFO:teuthology.orchestra.run.smithi150.stderr:INFO 2024-09-11 14:11:36,736 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 2-3 2024-09-11T14:11:36.737 INFO:teuthology.orchestra.run.smithi150.stderr:DEBUG 2024-09-11 14:11:36,737 [shard 0:main] seastar - reactor::drain 2024-09-11T14:11:37.243 INFO:teuthology.orchestra.run.smithi150.stderr:----------------------------------------------------- 2024-09-11T14:11:37.244 INFO:teuthology.orchestra.run.smithi150.stderr:Suppressions used: 2024-09-11T14:11:37.244 INFO:teuthology.orchestra.run.smithi150.stderr: count bytes template 2024-09-11T14:11:37.244 INFO:teuthology.orchestra.run.smithi150.stderr: 1 8 MallocExtension::Register 2024-09-11T14:11:37.244 INFO:teuthology.orchestra.run.smithi150.stderr:----------------------------------------------------- 2024-09-11T14:11:37.244 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-11T14:11:37.300 INFO:teuthology.orchestra.run.smithi150.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:11:37.304 INFO:teuthology.orchestra.run.smithi150.stderr:INFO 2024-09-11 14:11:37,304 seastar - Reactor backend: linux-aio 2024-09-11T14:11:37.317 INFO:teuthology.orchestra.run.smithi150.stderr:==27818==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:11:37.602 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x161f3c 0xc928c 0xc9e39 0x36074f8 0x3b8bf76 0x3b8c16e 0xb9d303b 0xb9d32f0 0xb9bb6c1 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:11:37.603 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:37.660 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x117f8f 0x60cd9e4 0x9eb3a95 0x9eb424c 0x9eb4526 0x9eb48ce 0x9eb7ca8 0x9eb8904 0x9eb8bc7 0x9eb983e 0x9e04da2 0x99e3021 0x99e3627 0x98d8560 0x9311261 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:11:37.660 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:37.811 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x552586d 0x9e169eb 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:37.811 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:37.868 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x4ab17 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:37.868 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:37.900 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x156dc 0xdd312 0x4ab1c 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:11:37.900 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:37.958 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x5525293 0x9e169c9 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:11:37.958 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:37.976 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x5525e2e 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:37.976 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:38.065 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x10d767 0xdd31a 0x4ab1c 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:11:38.066 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:38.486 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x5525da9 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:38.486 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:38.543 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x9e169b8 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:38.544 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:39.492 INFO:teuthology.orchestra.run.smithi150.stderr:----------------------------------------------------- 2024-09-11T14:11:39.492 INFO:teuthology.orchestra.run.smithi150.stderr:Suppressions used: 2024-09-11T14:11:39.492 INFO:teuthology.orchestra.run.smithi150.stderr: count bytes template 2024-09-11T14:11:39.492 INFO:teuthology.orchestra.run.smithi150.stderr: 1 8 MallocExtension::Register 2024-09-11T14:11:39.492 INFO:teuthology.orchestra.run.smithi150.stderr:----------------------------------------------------- 2024-09-11T14:11:39.493 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-11T14:11:39.518 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T14:11:39.543 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:11:39.819 INFO:teuthology.orchestra.run.smithi150.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:11:39.819 INFO:teuthology.orchestra.run.smithi150.stderr:INFO 2024-09-11 14:11:39,819 seastar - Reactor backend: linux-aio 2024-09-11T14:11:39.825 INFO:teuthology.orchestra.run.smithi150.stderr:==27865==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:11:39.931 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x156cf 0xdd312 0x4ab1c 0x5fccd96 0x5fccfac 0x5fcd18f 0x5fcd465 0x601bb63 0x601bd69 0x5f9beb6 0x5f9c090 0x5f9c61c 0x5de41ab 0x5dfc3ed 0x713aa42 0x714c215 0x714d6b2 0x714d737 0x714d839 0x714d931 0x714db3e 0x714dd24 0x714e073 0x714e417 0x714e647 0x714e8b1 0x714eb7e 0x714ed9c 0x714ee54 0x714ef1a 0x714effb 0x5c46fec 0x5c470f6 0x5c471b2 0x5c4726e 0x5c4732a 0x5c47477 0x5c47602 0x5c479c3 0x5c617c6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3961af8 0x39632d2 0x3803c28 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:39.931 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:39.942 INFO:teuthology.orchestra.run.smithi150.stderr:INFO 2024-09-11 14:11:39,941 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:11:39.942 INFO:teuthology.orchestra.run.smithi150.stderr:INFO 2024-09-11 14:11:39,941 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 4-5 2024-09-11T14:11:39.942 INFO:teuthology.orchestra.run.smithi150.stderr:DEBUG 2024-09-11 14:11:39,942 [shard 0:main] seastar - reactor::drain 2024-09-11T14:11:40.445 INFO:teuthology.orchestra.run.smithi150.stderr:----------------------------------------------------- 2024-09-11T14:11:40.445 INFO:teuthology.orchestra.run.smithi150.stderr:Suppressions used: 2024-09-11T14:11:40.445 INFO:teuthology.orchestra.run.smithi150.stderr: count bytes template 2024-09-11T14:11:40.445 INFO:teuthology.orchestra.run.smithi150.stderr: 1 8 MallocExtension::Register 2024-09-11T14:11:40.445 INFO:teuthology.orchestra.run.smithi150.stderr:----------------------------------------------------- 2024-09-11T14:11:40.445 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-11T14:11:40.507 INFO:teuthology.orchestra.run.smithi150.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:11:40.511 INFO:teuthology.orchestra.run.smithi150.stderr:INFO 2024-09-11 14:11:40,511 seastar - Reactor backend: linux-aio 2024-09-11T14:11:40.528 INFO:teuthology.orchestra.run.smithi150.stderr:==27863==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:11:40.807 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x125008 0x421f3 0x3ecea 0xfc9b1 0x377992e 0xb9294e8 0xb9b552d 0xb9bb547 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:11:40.807 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:41.011 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x4ab07 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:41.011 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:41.069 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x4aba4 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:41.069 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:41.111 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x552586d 0x9e169eb 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:11:41.111 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:41.168 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xdd2f7 0x4ab1c 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:11:41.169 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:41.176 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x9e169d6 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:41.176 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:41.276 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x9e169eb 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:11:41.276 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:41.571 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xc928f 0xc9e39 0x36074f8 0x3b8bf76 0x3b8c16e 0xb9cc2d7 0xb9cd5aa 0xb9cd824 0xb9cd9cc 0xb9cff97 0xb9bbafc 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x92f4f86 0x92f5a2a 0x92f5aad 0x92f5b32 0x92f5c34 0x92f5d2c 0x92f5db2 0x92f5e6b 0x92f6021 0x92f6159 0x92f61d4 0x92f6259 0x92f63b4 0x92f64ce 0x92f6553 0x92f6631 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:11:41.571 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:41.679 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x10798a 0xdd2fc 0x4ab1c 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:41.679 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:41.736 INFO:teuthology.orchestra.run.smithi150.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x55252a4 0x9e169c9 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:11:41.737 INFO:teuthology.orchestra.run.smithi150.stderr:kernel callstack: 2024-09-11T14:11:42.663 INFO:teuthology.orchestra.run.smithi150.stderr:----------------------------------------------------- 2024-09-11T14:11:42.744 INFO:teuthology.orchestra.run.smithi150.stderr:Suppressions used: 2024-09-11T14:11:42.744 INFO:teuthology.orchestra.run.smithi150.stderr: count bytes template 2024-09-11T14:11:42.744 INFO:teuthology.orchestra.run.smithi150.stderr: 1 8 MallocExtension::Register 2024-09-11T14:11:42.744 INFO:teuthology.orchestra.run.smithi150.stderr:----------------------------------------------------- 2024-09-11T14:11:42.744 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-11T14:11:42.745 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T14:11:42.771 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T14:11:42.772 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:42.772 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T14:11:42.836 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:42.837 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T14:11:42.903 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:42.903 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T14:11:42.967 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:42.968 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T14:11:43.032 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:43.032 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T14:11:43.089 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T14:11:43.089 DEBUG:teuthology.orchestra.run.smithi150:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T14:11:43.152 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.x] 2024-09-11T14:11:43.153 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQASpeFmp9qsKhAAby2m4CJ2qqAKqwp9x2CURg== 2024-09-11T14:11:43.153 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2024-09-11T14:11:43.153 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAWpeFmB716DhAAQ3tr2FHfqMuEWAGz2wnH+Q== 2024-09-11T14:11:43.153 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2024-09-11T14:11:43.153 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAZpeFmTG5ZGxAAn9IVeZHcEgISxL1Kd1lXsQ== 2024-09-11T14:11:43.153 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2024-09-11T14:11:43.153 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAcpeFmw5jVJxAAlt63Lm/+BNhXaxyW+ilVKA== 2024-09-11T14:11:43.153 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-11T14:11:43.153 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQASpeFmqgPXLRAASXdUIK7nA/U2XzWCdC67uQ== 2024-09-11T14:11:43.155 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T14:11:43.257 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:11:43.318 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:11:43.379 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:11:43.441 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T14:11:43.506 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T14:11:43.506 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T14:11:43.532 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T14:11:43.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:43.660+0000 7fecb2a3ac00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:43.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:43.660+0000 7fecb2a3ac00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:43.676 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T14:11:43.700 DEBUG:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:11:43.756 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T14:11:43.756 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T14:11:43.756 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T14:11:43.800 INFO:tasks.ceph.mon.a:Started 2024-09-11T14:11:43.800 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T14:11:43.801 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T14:11:43.801 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T14:11:43.803 INFO:tasks.ceph.mgr.x:Started 2024-09-11T14:11:43.803 DEBUG:tasks.ceph:set 0 configs 2024-09-11T14:11:43.803 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T14:11:43.803 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T14:11:43.881 INFO:tasks.ceph.mon.a.smithi150.stderr:2024-09-11T14:11:43.879+0000 7faf8f40dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:43.882 INFO:tasks.ceph.mon.a.smithi150.stderr:2024-09-11T14:11:43.879+0000 7faf8f40dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:43.882 INFO:tasks.ceph.mon.a.smithi150.stderr:2024-09-11T14:11:43.880+0000 7faf8f40dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:43.885 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-11T14:11:43.883+0000 7f7d10fdd000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:43.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:43.906+0000 7fd83b4ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:43.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:43.916+0000 7fd83b4ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:43.987 INFO:teuthology.orchestra.run.smithi150.stderr:adjusted tunables profile to default 2024-09-11T14:11:43.998 INFO:tasks.ceph:check_enable_crimson: True 2024-09-11T14:11:43.999 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-11T14:11:43.999 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-11T14:11:44.091 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-11T14:11:44.089+0000 7f7d10fdd000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:44.091 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-11T14:11:44.089+0000 7f7d10fdd000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:44.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:44.097+0000 7f3062cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:44.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:44.106+0000 7f3062cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:44.190 INFO:tasks.ceph.mon.a.smithi150.stderr:2024-09-11T14:11:44.188+0000 7faf873f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-11T14:11:44.190 INFO:tasks.ceph.mon.a.smithi150.stderr:Please be aware that this feature is experimental, untested, 2024-09-11T14:11:44.190 INFO:tasks.ceph.mon.a.smithi150.stderr:unsupported, and may result in data corruption, data loss, 2024-09-11T14:11:44.191 INFO:tasks.ceph.mon.a.smithi150.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-11T14:11:44.191 INFO:tasks.ceph.mon.a.smithi150.stderr:feature with important data. 2024-09-11T14:11:44.191 INFO:tasks.ceph.mon.a.smithi150.stderr: 2024-09-11T14:11:45.000 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T14:11:45.000 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:45.000 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T14:11:45.024 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:45.025 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T14:11:45.090 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:11:45.090 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T14:11:45.155 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 543e464a-b4bc-4d3e-952d-b5fbf540624f 0 2024-09-11T14:11:45.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:45.294+0000 7f8a4b311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:45.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:45.304+0000 7f8a4b311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:45.383 INFO:teuthology.orchestra.run.smithi150.stdout:0 2024-09-11T14:11:45.394 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new e81b8c2a-85c2-44c1-acca-0d42c45e04b2 1 2024-09-11T14:11:45.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:45.494+0000 7fc6e0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:45.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:45.504+0000 7fc6e0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:45.584 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-11T14:11:45.596 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 270c07cb-97e2-4a48-b652-abddda6a76f3 2 2024-09-11T14:11:45.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:45.696+0000 7f4a73288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:45.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:45.705+0000 7f4a73288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:45.785 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-09-11T14:11:45.797 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-11T14:11:45.826 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T14:11:45.827 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-11T14:11:45.869 INFO:tasks.ceph.osd.0:Started 2024-09-11T14:11:45.870 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-11T14:11:45.900 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T14:11:45.900 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-11T14:11:45.944 INFO:tasks.ceph.osd.1:Started 2024-09-11T14:11:45.945 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-11T14:11:45.977 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T14:11:45.978 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-11T14:11:46.020 INFO:tasks.ceph.osd.2:Started 2024-09-11T14:11:46.020 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:11:46.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:46.140+0000 7f64cded1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:46.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:46.150+0000 7f64cded1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:46.222 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:46.222 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":6,"fsid":"460d6576-fe4d-4af0-a3e1-de2d64971e7b","created":"2024-09-11T14:11:43.902616+0000","modified":"2024-09-11T14:11:45.784741+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T14:11:45.784741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"543e464a-b4bc-4d3e-952d-b5fbf540624f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e81b8c2a-85c2-44c1-acca-0d42c45e04b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"270c07cb-97e2-4a48-b652-abddda6a76f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:11:46.236 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T14:11:46.237 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T14:11:46.539 DEBUG:teuthology.orchestra.run.smithi150:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T14:11:46.643 INFO:teuthology.misc.health.smithi150.stderr:2024-09-11T14:11:46.637+0000 7fda64c5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:46.647 INFO:teuthology.misc.health.smithi150.stderr:2024-09-11T14:11:46.646+0000 7fda64c5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:46.718 INFO:teuthology.misc.health.smithi150.stdout: 2024-09-11T14:11:46.718 INFO:teuthology.misc.health.smithi150.stdout:{"epoch":6,"fsid":"460d6576-fe4d-4af0-a3e1-de2d64971e7b","created":"2024-09-11T14:11:43.902616+0000","modified":"2024-09-11T14:11:45.784741+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T14:11:45.784741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"543e464a-b4bc-4d3e-952d-b5fbf540624f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e81b8c2a-85c2-44c1-acca-0d42c45e04b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"270c07cb-97e2-4a48-b652-abddda6a76f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:11:46.729 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-11T14:11:49.509 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-11T14:11:49.507+0000 7f7cae26d640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-11T14:11:53.031 DEBUG:teuthology.orchestra.run.smithi150:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T14:11:53.143 INFO:teuthology.misc.health.smithi150.stderr:2024-09-11T14:11:53.138+0000 7f1ca3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:53.147 INFO:teuthology.misc.health.smithi150.stderr:2024-09-11T14:11:53.145+0000 7f1ca3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:53.331 INFO:teuthology.misc.health.smithi150.stdout: 2024-09-11T14:11:53.331 INFO:teuthology.misc.health.smithi150.stdout:{"epoch":10,"fsid":"460d6576-fe4d-4af0-a3e1-de2d64971e7b","created":"2024-09-11T14:11:43.902616+0000","modified":"2024-09-11T14:11:52.567120+0000","last_up_change":"2024-09-11T14:11:51.558137+0000","last_in_change":"2024-09-11T14:11:45.784741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:11:52.515741+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"543e464a-b4bc-4d3e-952d-b5fbf540624f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":2294736134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2294736134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":2294736134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2294736134}]},"public_addr":"172.21.15.150:6807/2294736134","cluster_addr":"172.21.15.150:6802/2294736134","heartbeat_back_addr":"172.21.15.150:6811/2294736134","heartbeat_front_addr":"172.21.15.150:6810/2294736134","state":["exists","up"]},{"osd":1,"uuid":"e81b8c2a-85c2-44c1-acca-0d42c45e04b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6803","nonce":2030851888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2030851888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2030851888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6805","nonce":2030851888}]},"public_addr":"172.21.15.150:6803/2030851888","cluster_addr":"172.21.15.150:6804/2030851888","heartbeat_back_addr":"172.21.15.150:6806/2030851888","heartbeat_front_addr":"172.21.15.150:6805/2030851888","state":["exists","up"]},{"osd":2,"uuid":"270c07cb-97e2-4a48-b652-abddda6a76f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":308045515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":308045515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":308045515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":308045515}]},"public_addr":"172.21.15.150:6809/308045515","cluster_addr":"172.21.15.150:6808/308045515","heartbeat_back_addr":"172.21.15.150:6812/308045515","heartbeat_front_addr":"172.21.15.150:6813/308045515","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:11:53.343 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-11T14:11:53.343 INFO:tasks.ceph:Creating RBD pool 2024-09-11T14:11:53.344 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-11T14:11:53.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:53.442+0000 7f1e3ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:53.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:53.453+0000 7f1e3ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:54.582 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'rbd' created 2024-09-11T14:11:54.599 DEBUG:teuthology.orchestra.run.smithi150:> rbd --cluster ceph pool init rbd 2024-09-11T14:11:54.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:54.707+0000 7f8d8960fac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:54.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:54.707+0000 7f8d8960fac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:54.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:54.712+0000 7f8d8960fac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:57.653 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T14:11:57.653 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-11T14:11:57.654 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T14:11:57.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:57.758+0000 7fbd24b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:57.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:57.767+0000 7fbd24b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:57.952 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:57.965 INFO:teuthology.orchestra.run.smithi150.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-11T14:11:57.965 INFO:tasks.ceph_manager:config epoch is 1 2024-09-11T14:11:57.965 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T14:11:57.965 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T14:11:57.965 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T14:11:58.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:58.068+0000 7ff9d6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:58.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:58.075+0000 7ff9d6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:58.309 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:58.320 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":768821452},{"type":"v1","addr":"172.21.15.150:6801","nonce":768821452}]},"active_addr":"172.21.15.150:6801/768821452","active_change":"2024-09-11T14:11:48.493105+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":2951107403}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":2018519277}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":2236747767}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":2683796886}]}]} 2024-09-11T14:11:58.322 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T14:11:58.322 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T14:11:58.323 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:11:58.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:58.426+0000 7ffa498fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:58.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:58.433+0000 7ffa498fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:58.621 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:58.622 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":15,"fsid":"460d6576-fe4d-4af0-a3e1-de2d64971e7b","created":"2024-09-11T14:11:43.902616+0000","modified":"2024-09-11T14:11:57.591250+0000","last_up_change":"2024-09-11T14:11:51.558137+0000","last_in_change":"2024-09-11T14:11:45.784741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:11:52.515741+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:11:53.650031+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"543e464a-b4bc-4d3e-952d-b5fbf540624f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":2294736134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2294736134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":2294736134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2294736134}]},"public_addr":"172.21.15.150:6807/2294736134","cluster_addr":"172.21.15.150:6802/2294736134","heartbeat_back_addr":"172.21.15.150:6811/2294736134","heartbeat_front_addr":"172.21.15.150:6810/2294736134","state":["exists","up"]},{"osd":1,"uuid":"e81b8c2a-85c2-44c1-acca-0d42c45e04b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6803","nonce":2030851888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2030851888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2030851888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6805","nonce":2030851888}]},"public_addr":"172.21.15.150:6803/2030851888","cluster_addr":"172.21.15.150:6804/2030851888","heartbeat_back_addr":"172.21.15.150:6806/2030851888","heartbeat_front_addr":"172.21.15.150:6805/2030851888","state":["exists","up"]},{"osd":2,"uuid":"270c07cb-97e2-4a48-b652-abddda6a76f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":308045515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":308045515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":308045515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":308045515}]},"public_addr":"172.21.15.150:6809/308045515","cluster_addr":"172.21.15.150:6808/308045515","heartbeat_back_addr":"172.21.15.150:6812/308045515","heartbeat_front_addr":"172.21.15.150:6813/308045515","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:11:58.635 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T14:11:58.635 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:11:58.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:58.737+0000 7ff3586fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:58.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:58.745+0000 7ff3586fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:58.930 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:58.930 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":15,"fsid":"460d6576-fe4d-4af0-a3e1-de2d64971e7b","created":"2024-09-11T14:11:43.902616+0000","modified":"2024-09-11T14:11:57.591250+0000","last_up_change":"2024-09-11T14:11:51.558137+0000","last_in_change":"2024-09-11T14:11:45.784741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:11:52.515741+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:11:53.650031+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"543e464a-b4bc-4d3e-952d-b5fbf540624f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":2294736134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2294736134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":2294736134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2294736134}]},"public_addr":"172.21.15.150:6807/2294736134","cluster_addr":"172.21.15.150:6802/2294736134","heartbeat_back_addr":"172.21.15.150:6811/2294736134","heartbeat_front_addr":"172.21.15.150:6810/2294736134","state":["exists","up"]},{"osd":1,"uuid":"e81b8c2a-85c2-44c1-acca-0d42c45e04b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6803","nonce":2030851888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2030851888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2030851888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6805","nonce":2030851888}]},"public_addr":"172.21.15.150:6803/2030851888","cluster_addr":"172.21.15.150:6804/2030851888","heartbeat_back_addr":"172.21.15.150:6806/2030851888","heartbeat_front_addr":"172.21.15.150:6805/2030851888","state":["exists","up"]},{"osd":2,"uuid":"270c07cb-97e2-4a48-b652-abddda6a76f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":308045515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":308045515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":308045515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":308045515}]},"public_addr":"172.21.15.150:6809/308045515","cluster_addr":"172.21.15.150:6808/308045515","heartbeat_back_addr":"172.21.15.150:6812/308045515","heartbeat_front_addr":"172.21.15.150:6813/308045515","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:11:58.944 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T14:11:58.944 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T14:11:58.944 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T14:11:59.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.054+0000 7f84b6391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:59.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.054+0000 7f5994591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:59.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.054+0000 7fe6c12d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:59.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.063+0000 7f5994591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:59.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.063+0000 7fe6c12d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:59.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.063+0000 7f84b6391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:59.096 INFO:teuthology.orchestra.run.smithi150.stdout:38654705671 2024-09-11T14:11:59.097 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T14:11:59.098 INFO:teuthology.orchestra.run.smithi150.stdout:34359738376 2024-09-11T14:11:59.098 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T14:11:59.100 INFO:teuthology.orchestra.run.smithi150.stdout:38654705671 2024-09-11T14:11:59.100 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T14:11:59.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.204+0000 7f5f1fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:59.217 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.216+0000 7f5f1fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:59.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.248+0000 7f0258eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:59.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.248+0000 7f8e65791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:59.259 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.257+0000 7f8e65791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:59.259 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.257+0000 7f0258eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:59.414 INFO:teuthology.orchestra.run.smithi150.stdout:38654705671 2024-09-11T14:11:59.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-09-11T14:11:59.427 DEBUG:teuthology.parallel:result is None 2024-09-11T14:11:59.454 INFO:teuthology.orchestra.run.smithi150.stdout:34359738376 2024-09-11T14:11:59.457 INFO:teuthology.orchestra.run.smithi150.stdout:38654705671 2024-09-11T14:11:59.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.1 2024-09-11T14:11:59.468 DEBUG:teuthology.parallel:result is None 2024-09-11T14:11:59.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-09-11T14:11:59.470 DEBUG:teuthology.parallel:result is None 2024-09-11T14:11:59.471 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T14:11:59.471 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:11:59.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.616+0000 7f6ea9ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:59.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.623+0000 7f6ea9ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:59.807 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:11:59.808 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-11T14:11:59.821 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-11T14:11:59.084456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":3372,"kb_used_data":3372,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156889812,"statfs":{"total":160658620416,"available":160655167488,"internally_reserved":0,"allocated":3452928,"data_stored":3452928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.611190+0000","last_change":"2024-09-11T14:11:57.623704+0000","last_active":"2024-09-11T14:11:57.611190+0000","last_peered":"2024-09-11T14:11:57.611190+0000","last_clean":"2024-09-11T14:11:57.611190+0000","last_became_active":"2024-09-11T14:11:55.714381+0000","last_became_peered":"2024-09-11T14:11:55.714381+0000","last_unstale":"2024-09-11T14:11:57.611190+0000","last_undegraded":"2024-09-11T14:11:57.611190+0000","last_fullsized":"2024-09-11T14:11:57.611190+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.621530+0000","last_change":"2024-09-11T14:11:57.629561+0000","last_active":"2024-09-11T14:11:57.621530+0000","last_peered":"2024-09-11T14:11:57.621530+0000","last_clean":"2024-09-11T14:11:57.621530+0000","last_became_active":"2024-09-11T14:11:55.698337+0000","last_became_peered":"2024-09-11T14:11:55.698337+0000","last_unstale":"2024-09-11T14:11:57.621530+0000","last_undegraded":"2024-09-11T14:11:57.621530+0000","last_fullsized":"2024-09-11T14:11:57.621530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.616790+0000","last_change":"2024-09-11T14:11:57.624547+0000","last_active":"2024-09-11T14:11:57.616790+0000","last_peered":"2024-09-11T14:11:57.616790+0000","last_clean":"2024-09-11T14:11:57.616790+0000","last_became_active":"2024-09-11T14:11:55.659262+0000","last_became_peered":"2024-09-11T14:11:55.659262+0000","last_unstale":"2024-09-11T14:11:57.616790+0000","last_undegraded":"2024-09-11T14:11:57.616790+0000","last_fullsized":"2024-09-11T14:11:57.616790+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.615137+0000","last_change":"2024-09-11T14:11:57.624865+0000","last_active":"2024-09-11T14:11:57.615137+0000","last_peered":"2024-09-11T14:11:57.615137+0000","last_clean":"2024-09-11T14:11:57.615137+0000","last_became_active":"2024-09-11T14:11:55.673781+0000","last_became_peered":"2024-09-11T14:11:55.673781+0000","last_unstale":"2024-09-11T14:11:57.615137+0000","last_undegraded":"2024-09-11T14:11:57.615137+0000","last_fullsized":"2024-09-11T14:11:57.615137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.628601+0000","last_change":"2024-09-11T14:11:57.628601+0000","last_active":"2024-09-11T14:11:57.628601+0000","last_peered":"2024-09-11T14:11:57.628601+0000","last_clean":"2024-09-11T14:11:57.628601+0000","last_became_active":"2024-09-11T14:11:55.675250+0000","last_became_peered":"2024-09-11T14:11:55.675250+0000","last_unstale":"2024-09-11T14:11:57.628601+0000","last_undegraded":"2024-09-11T14:11:57.628601+0000","last_fullsized":"2024-09-11T14:11:57.628601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.619708+0000","last_change":"2024-09-11T14:11:57.623633+0000","last_active":"2024-09-11T14:11:57.619708+0000","last_peered":"2024-09-11T14:11:57.619708+0000","last_clean":"2024-09-11T14:11:57.619708+0000","last_became_active":"2024-09-11T14:11:55.655763+0000","last_became_peered":"2024-09-11T14:11:55.655763+0000","last_unstale":"2024-09-11T14:11:57.619708+0000","last_undegraded":"2024-09-11T14:11:57.619708+0000","last_fullsized":"2024-09-11T14:11:57.619708+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.613631+0000","last_change":"2024-09-11T14:11:57.618994+0000","last_active":"2024-09-11T14:11:57.613631+0000","last_peered":"2024-09-11T14:11:57.613631+0000","last_clean":"2024-09-11T14:11:57.613631+0000","last_became_active":"2024-09-11T14:11:55.710679+0000","last_became_peered":"2024-09-11T14:11:55.710679+0000","last_unstale":"2024-09-11T14:11:57.613631+0000","last_undegraded":"2024-09-11T14:11:57.613631+0000","last_fullsized":"2024-09-11T14:11:57.613631+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.624374+0000","last_change":"2024-09-11T14:11:57.629234+0000","last_active":"2024-09-11T14:11:57.624374+0000","last_peered":"2024-09-11T14:11:57.624374+0000","last_clean":"2024-09-11T14:11:57.624374+0000","last_became_active":"2024-09-11T14:11:55.668793+0000","last_became_peered":"2024-09-11T14:11:55.668793+0000","last_unstale":"2024-09-11T14:11:57.624374+0000","last_undegraded":"2024-09-11T14:11:57.624374+0000","last_fullsized":"2024-09-11T14:11:57.624374+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":87,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.613601+0000","last_change":"2024-09-11T14:11:53.635879+0000","last_active":"2024-09-11T14:11:57.613601+0000","last_peered":"2024-09-11T14:11:57.613601+0000","last_clean":"2024-09-11T14:11:57.613601+0000","last_became_active":"2024-09-11T14:11:53.618322+0000","last_became_peered":"2024-09-11T14:11:53.618322+0000","last_unstale":"2024-09-11T14:11:57.613601+0000","last_undegraded":"2024-09-11T14:11:57.613601+0000","last_fullsized":"2024-09-11T14:11:57.613601+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:52.567120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:52.567120+0000","last_clean_scrub_stamp":"2024-09-11T14:11:52.567120+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160655167488,"internally_reserved":0,"allocated":3452928,"data_stored":3452928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551239168,"internally_reserved":0,"allocated":1634304,"data_stored":1634304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":436,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297292,"statfs":{"total":53552873472,"available":53552427008,"internally_reserved":0,"allocated":446464,"data_stored":446464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1596,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296132,"statfs":{"total":53552873472,"available":53551239168,"internally_reserved":0,"allocated":1634304,"data_stored":1634304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1340,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296388,"statfs":{"total":53552873472,"available":53551501312,"internally_reserved":0,"allocated":1372160,"data_stored":1372160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53551239168,"internally_reserved":0,"allocated":1634304,"data_stored":1634304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551501312,"internally_reserved":0,"allocated":1372160,"data_stored":1372160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551239168,"internally_reserved":0,"allocated":1634304,"data_stored":1634304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552427008,"internally_reserved":0,"allocated":446464,"data_stored":446464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:11:59.821 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:11:59.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.924+0000 7f6239511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:59.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:11:59.931+0000 7f6239511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:12:00.113 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:12:00.114 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-11T14:12:00.127 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-11T14:11:59.084456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":3372,"kb_used_data":3372,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156889812,"statfs":{"total":160658620416,"available":160655167488,"internally_reserved":0,"allocated":3452928,"data_stored":3452928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.611190+0000","last_change":"2024-09-11T14:11:57.623704+0000","last_active":"2024-09-11T14:11:57.611190+0000","last_peered":"2024-09-11T14:11:57.611190+0000","last_clean":"2024-09-11T14:11:57.611190+0000","last_became_active":"2024-09-11T14:11:55.714381+0000","last_became_peered":"2024-09-11T14:11:55.714381+0000","last_unstale":"2024-09-11T14:11:57.611190+0000","last_undegraded":"2024-09-11T14:11:57.611190+0000","last_fullsized":"2024-09-11T14:11:57.611190+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.621530+0000","last_change":"2024-09-11T14:11:57.629561+0000","last_active":"2024-09-11T14:11:57.621530+0000","last_peered":"2024-09-11T14:11:57.621530+0000","last_clean":"2024-09-11T14:11:57.621530+0000","last_became_active":"2024-09-11T14:11:55.698337+0000","last_became_peered":"2024-09-11T14:11:55.698337+0000","last_unstale":"2024-09-11T14:11:57.621530+0000","last_undegraded":"2024-09-11T14:11:57.621530+0000","last_fullsized":"2024-09-11T14:11:57.621530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.616790+0000","last_change":"2024-09-11T14:11:57.624547+0000","last_active":"2024-09-11T14:11:57.616790+0000","last_peered":"2024-09-11T14:11:57.616790+0000","last_clean":"2024-09-11T14:11:57.616790+0000","last_became_active":"2024-09-11T14:11:55.659262+0000","last_became_peered":"2024-09-11T14:11:55.659262+0000","last_unstale":"2024-09-11T14:11:57.616790+0000","last_undegraded":"2024-09-11T14:11:57.616790+0000","last_fullsized":"2024-09-11T14:11:57.616790+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.615137+0000","last_change":"2024-09-11T14:11:57.624865+0000","last_active":"2024-09-11T14:11:57.615137+0000","last_peered":"2024-09-11T14:11:57.615137+0000","last_clean":"2024-09-11T14:11:57.615137+0000","last_became_active":"2024-09-11T14:11:55.673781+0000","last_became_peered":"2024-09-11T14:11:55.673781+0000","last_unstale":"2024-09-11T14:11:57.615137+0000","last_undegraded":"2024-09-11T14:11:57.615137+0000","last_fullsized":"2024-09-11T14:11:57.615137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.628601+0000","last_change":"2024-09-11T14:11:57.628601+0000","last_active":"2024-09-11T14:11:57.628601+0000","last_peered":"2024-09-11T14:11:57.628601+0000","last_clean":"2024-09-11T14:11:57.628601+0000","last_became_active":"2024-09-11T14:11:55.675250+0000","last_became_peered":"2024-09-11T14:11:55.675250+0000","last_unstale":"2024-09-11T14:11:57.628601+0000","last_undegraded":"2024-09-11T14:11:57.628601+0000","last_fullsized":"2024-09-11T14:11:57.628601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.619708+0000","last_change":"2024-09-11T14:11:57.623633+0000","last_active":"2024-09-11T14:11:57.619708+0000","last_peered":"2024-09-11T14:11:57.619708+0000","last_clean":"2024-09-11T14:11:57.619708+0000","last_became_active":"2024-09-11T14:11:55.655763+0000","last_became_peered":"2024-09-11T14:11:55.655763+0000","last_unstale":"2024-09-11T14:11:57.619708+0000","last_undegraded":"2024-09-11T14:11:57.619708+0000","last_fullsized":"2024-09-11T14:11:57.619708+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.613631+0000","last_change":"2024-09-11T14:11:57.618994+0000","last_active":"2024-09-11T14:11:57.613631+0000","last_peered":"2024-09-11T14:11:57.613631+0000","last_clean":"2024-09-11T14:11:57.613631+0000","last_became_active":"2024-09-11T14:11:55.710679+0000","last_became_peered":"2024-09-11T14:11:55.710679+0000","last_unstale":"2024-09-11T14:11:57.613631+0000","last_undegraded":"2024-09-11T14:11:57.613631+0000","last_fullsized":"2024-09-11T14:11:57.613631+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.624374+0000","last_change":"2024-09-11T14:11:57.629234+0000","last_active":"2024-09-11T14:11:57.624374+0000","last_peered":"2024-09-11T14:11:57.624374+0000","last_clean":"2024-09-11T14:11:57.624374+0000","last_became_active":"2024-09-11T14:11:55.668793+0000","last_became_peered":"2024-09-11T14:11:55.668793+0000","last_unstale":"2024-09-11T14:11:57.624374+0000","last_undegraded":"2024-09-11T14:11:57.624374+0000","last_fullsized":"2024-09-11T14:11:57.624374+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":87,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:11:57.613601+0000","last_change":"2024-09-11T14:11:53.635879+0000","last_active":"2024-09-11T14:11:57.613601+0000","last_peered":"2024-09-11T14:11:57.613601+0000","last_clean":"2024-09-11T14:11:57.613601+0000","last_became_active":"2024-09-11T14:11:53.618322+0000","last_became_peered":"2024-09-11T14:11:53.618322+0000","last_unstale":"2024-09-11T14:11:57.613601+0000","last_undegraded":"2024-09-11T14:11:57.613601+0000","last_fullsized":"2024-09-11T14:11:57.613601+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:52.567120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:52.567120+0000","last_clean_scrub_stamp":"2024-09-11T14:11:52.567120+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160655167488,"internally_reserved":0,"allocated":3452928,"data_stored":3452928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551239168,"internally_reserved":0,"allocated":1634304,"data_stored":1634304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":436,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297292,"statfs":{"total":53552873472,"available":53552427008,"internally_reserved":0,"allocated":446464,"data_stored":446464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1596,"kb_used_data":1596,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296132,"statfs":{"total":53552873472,"available":53551239168,"internally_reserved":0,"allocated":1634304,"data_stored":1634304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1340,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296388,"statfs":{"total":53552873472,"available":53551501312,"internally_reserved":0,"allocated":1372160,"data_stored":1372160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53551239168,"internally_reserved":0,"allocated":1634304,"data_stored":1634304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551501312,"internally_reserved":0,"allocated":1372160,"data_stored":1372160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551239168,"internally_reserved":0,"allocated":1634304,"data_stored":1634304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552427008,"internally_reserved":0,"allocated":446464,"data_stored":446464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:12:00.128 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T14:12:00.128 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T14:12:00.128 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T14:12:00.128 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T14:12:00.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:12:00.231+0000 7fc5b4d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:12:00.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:12:00.237+0000 7fc5b4d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:12:00.461 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:12:00.462 INFO:teuthology.orchestra.run.smithi150.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T14:12:00.475 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T14:12:00.476 INFO:teuthology.run_tasks:Running task workunit... 2024-09-11T14:12:00.500 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-11T14:12:00.501 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T14:12:00.502 DEBUG:teuthology.orchestra.run.smithi150:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T14:12:00.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:12:00.520 INFO:teuthology.orchestra.run.smithi150.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-11T14:12:00.520 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-11T14:12:00.576 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-11T14:12:00.576 DEBUG:teuthology.orchestra.run.smithi150:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-11T14:12:00.633 INFO:tasks.workunit:timeout=3h 2024-09-11T14:12:00.633 INFO:tasks.workunit:cleanup=True 2024-09-11T14:12:00.634 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-11T14:12:00.690 INFO:tasks.workunit.client.0.smithi150.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T14:12:51.574 INFO:tasks.workunit.client.0.smithi150.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-09-11T14:12:51.575 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-11T14:12:51.575 INFO:tasks.workunit.client.0.smithi150.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T14:12:51.575 INFO:tasks.workunit.client.0.smithi150.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T14:12:51.575 INFO:tasks.workunit.client.0.smithi150.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T14:12:51.575 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-11T14:12:51.575 INFO:tasks.workunit.client.0.smithi150.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T14:12:51.575 INFO:tasks.workunit.client.0.smithi150.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T14:12:51.576 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-11T14:12:51.576 INFO:tasks.workunit.client.0.smithi150.stderr: git switch -c 2024-09-11T14:12:51.576 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-11T14:12:51.576 INFO:tasks.workunit.client.0.smithi150.stderr:Or undo this operation with: 2024-09-11T14:12:51.576 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-11T14:12:51.576 INFO:tasks.workunit.client.0.smithi150.stderr: git switch - 2024-09-11T14:12:51.576 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-11T14:12:51.576 INFO:tasks.workunit.client.0.smithi150.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T14:12:51.576 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-11T14:12:51.576 INFO:tasks.workunit.client.0.smithi150.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-09-11T14:12:51.579 DEBUG:teuthology.orchestra.run.smithi150:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-11T14:12:51.642 INFO:tasks.workunit.client.0.smithi150.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-11T14:12:51.644 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T14:12:51.644 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-11T14:12:52.263 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-11T14:12:52.337 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-11T14:12:52.377 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T14:12:52.379 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T14:12:52.379 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-11T14:12:52.417 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T14:12:52.420 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-11T14:12:52.421 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-11T14:12:52.477 INFO:tasks.workunit:Running workunits matching rbd/crimson/test_crimson_librbd.sh on client.0... 2024-09-11T14:12:52.478 INFO:tasks.workunit:Running workunit rbd/crimson/test_crimson_librbd.sh... 2024-09-11T14:12:52.478 DEBUG:teuthology.orchestra.run.smithi150:workunit test rbd/crimson/test_crimson_librbd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh 2024-09-11T14:12:52.584 INFO:tasks.workunit.client.0.smithi150.stdout:seed 29739 2024-09-11T14:12:52.585 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = TestLibRBD.* 2024-09-11T14:12:52.585 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 171 tests from 1 test suite. 2024-09-11T14:12:52.585 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:12:52.585 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 171 tests from TestLibRBD 2024-09-11T14:12:52.631 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.CreateAndStat 2024-09-11T14:12:53.929 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:12:56.091 INFO:tasks.workunit.client.0.smithi150.stdout:image has size 2097152 and order 22 2024-09-11T14:12:56.092 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.CreateAndStat (3460 ms) 2024-09-11T14:12:56.092 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.CreateWithSameDataPool 2024-09-11T14:12:56.092 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:780: Skipped 2024-09-11T14:12:56.092 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:12:56.092 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.CreateWithSameDataPool (0 ms) 2024-09-11T14:12:56.092 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.CreateAndStatPP 2024-09-11T14:12:56.092 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:12:56.197 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.CreateAndStatPP (106 ms) 2024-09-11T14:12:56.197 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.GetId 2024-09-11T14:12:56.198 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:12:56.301 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.GetId (103 ms) 2024-09-11T14:12:56.301 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.GetIdPP 2024-09-11T14:12:56.301 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:12:56.417 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.GetIdPP (116 ms) 2024-09-11T14:12:56.417 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefix 2024-09-11T14:12:56.417 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:12:56.530 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.GetBlockNamePrefix (114 ms) 2024-09-11T14:12:56.531 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefixPP 2024-09-11T14:12:56.531 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:12:56.637 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.GetBlockNamePrefixPP (106 ms) 2024-09-11T14:12:56.637 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestGetCreateTimestamp 2024-09-11T14:12:56.637 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:939: Skipped 2024-09-11T14:12:56.637 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:12:56.637 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestGetCreateTimestamp (0 ms) 2024-09-11T14:12:56.637 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.GetCreateTimestampPP 2024-09-11T14:12:56.637 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:962: Skipped 2024-09-11T14:12:56.638 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:12:56.638 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.GetCreateTimestampPP (0 ms) 2024-09-11T14:12:56.638 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.OpenAio 2024-09-11T14:12:56.638 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:12:56.740 INFO:tasks.workunit.client.0.smithi150.stdout:image has size 2097152 and order 22 2024-09-11T14:12:56.741 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.OpenAio (104 ms) 2024-09-11T14:12:56.741 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.OpenAioFail 2024-09-11T14:12:56.753 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.OpenAioFail (13 ms) 2024-09-11T14:12:56.753 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.OpenAioPP 2024-09-11T14:12:56.753 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:12:56.922 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.OpenAioPP (168 ms) 2024-09-11T14:12:56.922 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.OpenAioFailPP 2024-09-11T14:12:56.936 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.OpenAioFailPP (14 ms) 2024-09-11T14:12:56.936 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ResizeAndStat 2024-09-11T14:12:56.936 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:12:57.188 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.ResizeAndStat (252 ms) 2024-09-11T14:12:57.188 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ResizeAndStatPP 2024-09-11T14:12:57.188 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:12:57.393 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.ResizeAndStatPP (205 ms) 2024-09-11T14:12:57.393 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResize 2024-09-11T14:12:57.393 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:12:57.643 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.UpdateWatchAndResize (251 ms) 2024-09-11T14:12:57.643 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResizePP 2024-09-11T14:12:57.644 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:12:57.892 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.UpdateWatchAndResizePP (248 ms) 2024-09-11T14:12:57.892 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCreateLsDelete 2024-09-11T14:12:59.264 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:13:01.097 INFO:tasks.workunit.client.0.smithi150.stdout:image: image15 2024-09-11T14:13:01.097 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image15 2024-09-11T14:13:01.098 INFO:tasks.workunit.client.0.smithi150.stdout:found image15 2024-09-11T14:13:01.098 INFO:tasks.workunit.client.0.smithi150.stdout:erased image15 2024-09-11T14:13:01.098 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:13:01.377 INFO:tasks.workunit.client.0.smithi150.stdout:image: image15 2024-09-11T14:13:01.377 INFO:tasks.workunit.client.0.smithi150.stdout:image: image16 2024-09-11T14:13:01.377 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image15 2024-09-11T14:13:01.377 INFO:tasks.workunit.client.0.smithi150.stdout:found image15 2024-09-11T14:13:01.378 INFO:tasks.workunit.client.0.smithi150.stdout:erased image15 2024-09-11T14:13:01.378 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image16 2024-09-11T14:13:01.378 INFO:tasks.workunit.client.0.smithi150.stdout:found image16 2024-09-11T14:13:01.378 INFO:tasks.workunit.client.0.smithi150.stdout:erased image16 2024-09-11T14:13:01.378 INFO:tasks.workunit.client.0.smithi150.stdout:image: image16 2024-09-11T14:13:01.378 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image16 2024-09-11T14:13:01.378 INFO:tasks.workunit.client.0.smithi150.stdout:found image16 2024-09-11T14:13:01.378 INFO:tasks.workunit.client.0.smithi150.stdout:erased image16 2024-09-11T14:13:01.378 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCreateLsDelete (3486 ms) 2024-09-11T14:13:01.378 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCreateLsDeletePP 2024-09-11T14:13:02.969 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:13:05.139 INFO:tasks.workunit.client.0.smithi150.stdout:num images is: 1 2024-09-11T14:13:05.139 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 1 2024-09-11T14:13:05.140 INFO:tasks.workunit.client.0.smithi150.stdout:image: image17 2024-09-11T14:13:05.140 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image17 2024-09-11T14:13:05.140 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:13:05.206 INFO:tasks.workunit.client.0.smithi150.stdout:num images is: 2 2024-09-11T14:13:05.206 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 2 2024-09-11T14:13:05.206 INFO:tasks.workunit.client.0.smithi150.stdout:image: image17 2024-09-11T14:13:05.206 INFO:tasks.workunit.client.0.smithi150.stdout:image: image18 2024-09-11T14:13:05.207 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image17 2024-09-11T14:13:05.207 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image18 2024-09-11T14:13:05.342 INFO:tasks.workunit.client.0.smithi150.stdout:num images is: 1 2024-09-11T14:13:05.342 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 1 2024-09-11T14:13:05.343 INFO:tasks.workunit.client.0.smithi150.stdout:image: image18 2024-09-11T14:13:05.343 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image18 2024-09-11T14:13:05.343 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCreateLsDeletePP (3965 ms) 2024-09-11T14:13:05.343 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCopy 2024-09-11T14:13:06.997 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:13:15.985 INFO:tasks.workunit.client.0.smithi150.stdout:image: image19 2024-09-11T14:13:15.986 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image19 2024-09-11T14:13:15.986 INFO:tasks.workunit.client.0.smithi150.stdout:found image19 2024-09-11T14:13:15.986 INFO:tasks.workunit.client.0.smithi150.stdout:erased image19 2024-09-11T14:13:15.986 INFO:tasks.workunit.client.0.smithi150.stdout:image: image19 2024-09-11T14:13:15.986 INFO:tasks.workunit.client.0.smithi150.stdout:image: image20 2024-09-11T14:13:15.986 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image19 2024-09-11T14:13:15.986 INFO:tasks.workunit.client.0.smithi150.stdout:found image19 2024-09-11T14:13:15.986 INFO:tasks.workunit.client.0.smithi150.stdout:erased image19 2024-09-11T14:13:15.986 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image20 2024-09-11T14:13:15.986 INFO:tasks.workunit.client.0.smithi150.stdout:found image20 2024-09-11T14:13:15.987 INFO:tasks.workunit.client.0.smithi150.stdout:erased image20 2024-09-11T14:13:15.987 INFO:tasks.workunit.client.0.smithi150.stdout:0.00% done 2024-09-11T14:13:15.987 INFO:tasks.workunit.client.0.smithi150.stdout:100.00% done 2024-09-11T14:13:15.987 INFO:tasks.workunit.client.0.smithi150.stdout:image: image19 2024-09-11T14:13:15.987 INFO:tasks.workunit.client.0.smithi150.stdout:image: image20 2024-09-11T14:13:15.987 INFO:tasks.workunit.client.0.smithi150.stdout:image: image21 2024-09-11T14:13:15.987 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image19 2024-09-11T14:13:15.987 INFO:tasks.workunit.client.0.smithi150.stdout:found image19 2024-09-11T14:13:15.987 INFO:tasks.workunit.client.0.smithi150.stdout:erased image19 2024-09-11T14:13:15.987 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image20 2024-09-11T14:13:15.987 INFO:tasks.workunit.client.0.smithi150.stdout:found image20 2024-09-11T14:13:15.987 INFO:tasks.workunit.client.0.smithi150.stdout:erased image20 2024-09-11T14:13:15.987 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image21 2024-09-11T14:13:15.988 INFO:tasks.workunit.client.0.smithi150.stdout:found image21 2024-09-11T14:13:15.988 INFO:tasks.workunit.client.0.smithi150.stdout:erased image21 2024-09-11T14:13:15.988 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCopy (10643 ms) 2024-09-11T14:13:15.988 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCopyPP 2024-09-11T14:13:17.028 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:13:22.268 INFO:tasks.workunit.client.0.smithi150.stdout:num images is: 1 2024-09-11T14:13:22.268 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 1 2024-09-11T14:13:22.268 INFO:tasks.workunit.client.0.smithi150.stdout:image: image22 2024-09-11T14:13:22.268 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image22 2024-09-11T14:13:24.516 INFO:tasks.workunit.client.0.smithi150.stdout:num images is: 2 2024-09-11T14:13:24.516 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 2 2024-09-11T14:13:24.516 INFO:tasks.workunit.client.0.smithi150.stdout:image: image22 2024-09-11T14:13:24.516 INFO:tasks.workunit.client.0.smithi150.stdout:image: image23 2024-09-11T14:13:24.516 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image22 2024-09-11T14:13:24.516 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image23 2024-09-11T14:13:25.383 INFO:tasks.workunit.client.0.smithi150.stdout:0.00% done 2024-09-11T14:13:25.383 INFO:tasks.workunit.client.0.smithi150.stdout:100.00% done 2024-09-11T14:13:25.383 INFO:tasks.workunit.client.0.smithi150.stdout:num images is: 3 2024-09-11T14:13:25.383 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 3 2024-09-11T14:13:25.383 INFO:tasks.workunit.client.0.smithi150.stdout:image: image22 2024-09-11T14:13:25.383 INFO:tasks.workunit.client.0.smithi150.stdout:image: image23 2024-09-11T14:13:25.383 INFO:tasks.workunit.client.0.smithi150.stdout:image: image24 2024-09-11T14:13:25.384 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image22 2024-09-11T14:13:25.384 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image23 2024-09-11T14:13:25.384 INFO:tasks.workunit.client.0.smithi150.stdout:expected = image24 2024-09-11T14:13:26.045 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCopyPP (10059 ms) 2024-09-11T14:13:26.045 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestDeepCopy 2024-09-11T14:13:26.045 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:1578: Skipped 2024-09-11T14:13:26.045 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:13:26.045 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopy (0 ms) 2024-09-11T14:13:26.045 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestDeepCopyPP 2024-09-11T14:13:26.046 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:1745: Skipped 2024-09-11T14:13:26.046 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:13:26.046 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopyPP (0 ms) 2024-09-11T14:13:26.046 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnap 2024-09-11T14:13:26.046 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:13:30.268 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 1 2024-09-11T14:13:30.268 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 1 2024-09-11T14:13:30.268 INFO:tasks.workunit.client.0.smithi150.stdout:snap: snap1 2024-09-11T14:13:30.268 INFO:tasks.workunit.client.0.smithi150.stdout:found snap1 with size 2097152 2024-09-11T14:13:30.268 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 2 2024-09-11T14:13:30.268 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 2 2024-09-11T14:13:30.268 INFO:tasks.workunit.client.0.smithi150.stdout:snap: snap1 2024-09-11T14:13:30.268 INFO:tasks.workunit.client.0.smithi150.stdout:snap: snap2 2024-09-11T14:13:30.268 INFO:tasks.workunit.client.0.smithi150.stdout:found snap1 with size 2097152 2024-09-11T14:13:30.269 INFO:tasks.workunit.client.0.smithi150.stdout:found snap2 with size 4194304 2024-09-11T14:13:30.269 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 1 2024-09-11T14:13:30.269 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 1 2024-09-11T14:13:30.269 INFO:tasks.workunit.client.0.smithi150.stdout:snap: snap2 2024-09-11T14:13:30.269 INFO:tasks.workunit.client.0.smithi150.stdout:found snap2 with size 4194304 2024-09-11T14:13:30.269 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 0 2024-09-11T14:13:30.269 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 0 2024-09-11T14:13:30.269 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnap (4223 ms) 2024-09-11T14:13:30.269 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestGetSnapShotTimeStamp 2024-09-11T14:13:30.269 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:1890: Skipped 2024-09-11T14:13:30.269 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:13:30.269 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestGetSnapShotTimeStamp (0 ms) 2024-09-11T14:13:30.269 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnapPP 2024-09-11T14:13:30.269 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:13:31.272 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 1 2024-09-11T14:13:31.272 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 1 2024-09-11T14:13:31.272 INFO:tasks.workunit.client.0.smithi150.stdout:snap: snap1 2024-09-11T14:13:31.272 INFO:tasks.workunit.client.0.smithi150.stdout:found snap1 with size 2097152 2024-09-11T14:13:32.243 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 2 2024-09-11T14:13:32.243 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 2 2024-09-11T14:13:32.243 INFO:tasks.workunit.client.0.smithi150.stdout:snap: snap1 2024-09-11T14:13:32.243 INFO:tasks.workunit.client.0.smithi150.stdout:snap: snap2 2024-09-11T14:13:32.243 INFO:tasks.workunit.client.0.smithi150.stdout:found snap1 with size 2097152 2024-09-11T14:13:32.244 INFO:tasks.workunit.client.0.smithi150.stdout:found snap2 with size 4194304 2024-09-11T14:13:33.292 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 1 2024-09-11T14:13:33.292 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 1 2024-09-11T14:13:33.292 INFO:tasks.workunit.client.0.smithi150.stdout:snap: snap2 2024-09-11T14:13:33.292 INFO:tasks.workunit.client.0.smithi150.stdout:found snap2 with size 4194304 2024-09-11T14:13:34.291 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 0 2024-09-11T14:13:34.291 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 0 2024-09-11T14:13:34.311 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnapPP (4044 ms) 2024-09-11T14:13:34.311 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestGetNameIdSnapPP 2024-09-11T14:13:34.311 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:13:40.273 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 0 2024-09-11T14:13:40.273 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 0 2024-09-11T14:13:40.288 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestGetNameIdSnapPP (5977 ms) 2024-09-11T14:13:40.288 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCreateLsRenameSnapPP 2024-09-11T14:13:40.288 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:13:41.308 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 1 2024-09-11T14:13:41.308 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 1 2024-09-11T14:13:41.308 INFO:tasks.workunit.client.0.smithi150.stdout:snap: snap1 2024-09-11T14:13:41.308 INFO:tasks.workunit.client.0.smithi150.stdout:found snap1 with size 2097152 2024-09-11T14:13:42.323 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 2 2024-09-11T14:13:42.323 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 2 2024-09-11T14:13:42.323 INFO:tasks.workunit.client.0.smithi150.stdout:snap: snap1 2024-09-11T14:13:42.323 INFO:tasks.workunit.client.0.smithi150.stdout:snap: snap2 2024-09-11T14:13:42.323 INFO:tasks.workunit.client.0.smithi150.stdout:found snap1 with size 2097152 2024-09-11T14:13:42.323 INFO:tasks.workunit.client.0.smithi150.stdout:found snap2 with size 4194304 2024-09-11T14:13:42.375 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 2 2024-09-11T14:13:42.376 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 2 2024-09-11T14:13:42.376 INFO:tasks.workunit.client.0.smithi150.stdout:snap: snap1-rename 2024-09-11T14:13:42.376 INFO:tasks.workunit.client.0.smithi150.stdout:snap: snap2 2024-09-11T14:13:42.376 INFO:tasks.workunit.client.0.smithi150.stdout:found snap1-rename with size 2097152 2024-09-11T14:13:42.376 INFO:tasks.workunit.client.0.smithi150.stdout:found snap2 with size 4194304 2024-09-11T14:13:43.406 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 1 2024-09-11T14:13:43.407 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 1 2024-09-11T14:13:43.407 INFO:tasks.workunit.client.0.smithi150.stdout:snap: snap2-rename 2024-09-11T14:13:43.407 INFO:tasks.workunit.client.0.smithi150.stdout:found snap2-rename with size 4194304 2024-09-11T14:13:44.322 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 0 2024-09-11T14:13:44.322 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 0 2024-09-11T14:13:44.340 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCreateLsRenameSnapPP (4052 ms) 2024-09-11T14:13:44.341 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ConcurrentCreatesUnvalidatedPool 2024-09-11T14:13:46.146 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:13:46.146 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:13:46.146 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:13:46.146 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:13:49.007 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.ConcurrentCreatesUnvalidatedPool (4667 ms) 2024-09-11T14:13:49.008 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.RemoveFullTry 2024-09-11T14:13:53.403 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:14:25.008 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.RemoveFullTry (36000 ms) 2024-09-11T14:14:25.008 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.RemoveFullTryDataPool 2024-09-11T14:14:25.008 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:2227: Skipped 2024-09-11T14:14:25.009 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:14:25.009 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryDataPool (0 ms) 2024-09-11T14:14:25.009 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespace 2024-09-11T14:14:25.009 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:2247: Skipped 2024-09-11T14:14:25.009 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:14:25.009 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespace (0 ms) 2024-09-11T14:14:25.009 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespaceDataPool 2024-09-11T14:14:25.009 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:2269: Skipped 2024-09-11T14:14:25.009 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:14:25.009 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespaceDataPool (0 ms) 2024-09-11T14:14:25.009 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestIO 2024-09-11T14:14:25.009 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:14:53.283 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:14:53.284 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:14:53.284 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:14:53.284 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:14:53.284 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:14:53.284 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.284 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:14:53.284 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.285 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.285 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:14:53.285 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.285 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:14:53.285 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.285 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.285 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:14:53.285 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.285 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:14:53.285 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.285 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.285 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:14:53.285 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.286 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:14:53.286 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.286 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.286 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:14:53.286 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.286 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:14:53.286 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.286 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.286 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:14:53.286 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:14:53.286 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:14:53.286 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:14:53.286 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:14:53.287 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:14:53.287 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:14:53.287 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:14:53.287 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:14:53.287 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:14:53.287 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:14:53.287 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.287 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:14:53.287 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.287 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.287 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:14:53.287 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.287 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:14:53.287 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.288 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.288 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:14:53.288 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.288 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:14:53.288 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.288 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.288 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:14:53.288 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.288 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:14:53.288 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.288 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.288 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:14:53.288 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.289 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:14:53.289 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.289 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.289 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:14:53.289 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:14:53.289 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:14:53.289 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:14:53.289 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:14:53.289 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:14:53.289 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.289 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:14:53.289 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:14:53.289 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:14:53.289 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.290 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:14:53.290 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:14:53.290 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:14:53.290 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.290 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:14:53.290 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:14:53.290 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:14:53.290 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.290 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:14:53.290 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:14:53.290 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:14:53.290 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.290 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:14:53.290 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:14:53.290 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:14:53.291 INFO:tasks.workunit.client.0.smithi150.stdout:discard: 512~512 = 512 2024-09-11T14:14:53.291 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.291 INFO:tasks.workunit.client.0.smithi150.stdout:aio discard: 1536~512 = 0 2024-09-11T14:14:53.291 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:14:53.291 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:14:53.291 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:14:53.291 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:14:53.291 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:14:53.291 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 0 2024-09-11T14:14:53.291 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.291 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.291 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 0 2024-09-11T14:14:53.292 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.292 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.292 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 16384 2024-09-11T14:14:53.292 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.292 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.292 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 16384 2024-09-11T14:14:53.292 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.292 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.292 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:14:53.292 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:14:53.292 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 49152 2024-09-11T14:14:53.293 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.293 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.293 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 49152 2024-09-11T14:14:53.293 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.293 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.293 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 65536 2024-09-11T14:14:53.293 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.293 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.293 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 65536 2024-09-11T14:14:53.293 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.293 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.293 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:14:53.294 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:14:53.294 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 98304 2024-09-11T14:14:53.294 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.294 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.294 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 98304 2024-09-11T14:14:53.294 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.294 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.294 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 114688 2024-09-11T14:14:53.294 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.294 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.294 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 114688 2024-09-11T14:14:53.294 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.295 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.295 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:14:53.295 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:14:53.295 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 147456 2024-09-11T14:14:53.295 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.295 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.295 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 147456 2024-09-11T14:14:53.295 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.295 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.295 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 163840 2024-09-11T14:14:53.295 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.295 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.295 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 163840 2024-09-11T14:14:53.296 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.296 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.296 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:14:53.296 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:14:53.296 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 196608 2024-09-11T14:14:53.296 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.296 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.296 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 196608 2024-09-11T14:14:53.296 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.296 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.296 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 212992 2024-09-11T14:14:53.296 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.296 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.297 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 212992 2024-09-11T14:14:53.297 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.297 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.297 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:14:53.297 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:14:53.297 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.297 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:14:53.297 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.297 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.297 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:14:53.297 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.297 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.298 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.298 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:14:53.298 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.298 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.298 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:14:53.298 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.298 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.298 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.298 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:14:53.298 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.298 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.298 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:14:53.298 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.299 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.299 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.299 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:14:53.299 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.299 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.299 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:14:53.299 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.299 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.299 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.299 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:14:53.299 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:14:53.299 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.300 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:14:53.300 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:14:53.300 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.300 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:14:53.300 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.300 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.300 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:14:53.300 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.300 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.300 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:14:53.300 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:14:53.300 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:14:53.301 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:14:53.301 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:14:53.301 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:14:53.301 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:14:53.301 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.776 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.776 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:17.776 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:17.777 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:17.777 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:17.777 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:17.777 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.777 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.777 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:17.777 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:17.777 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:17.777 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:17.777 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:17.777 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.777 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.778 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:17.778 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.778 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.778 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:17.778 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.778 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.778 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:17.778 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:17.778 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:17.778 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:17.778 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:17.778 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.779 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.779 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:17.779 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:17.779 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:17.779 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:17.779 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:17.779 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.779 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.779 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:17.779 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:17.779 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:17.780 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:17.780 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:17.780 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.780 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.780 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:17.780 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:17.780 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:17.780 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:17.780 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:17.780 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.780 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.781 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:17.781 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.781 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.781 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:17.781 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.781 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.781 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:17.781 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:17.781 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:17.781 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:17.781 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:17.781 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.782 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.782 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:17.782 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:17.782 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:17.782 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:17.782 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:17.782 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.782 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.782 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:17.782 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:17.782 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:17.783 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:17.783 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:17.783 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.783 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.783 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:17.783 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:17.783 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:17.783 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:17.783 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:17.783 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.783 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.784 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:17.784 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.784 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.784 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:17.784 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.784 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.784 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:17.784 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:17.784 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:17.784 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:17.784 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:17.785 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.785 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.785 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:17.785 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:17.785 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:17.785 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:17.785 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:17.785 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.785 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.785 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:17.785 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:17.785 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:17.786 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:17.786 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:17.786 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.786 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.786 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:17.786 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:17.786 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:17.786 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:17.786 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:17.786 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.786 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.787 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:17.787 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:17.787 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:17.787 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:17.787 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:15:17.787 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:15:17.787 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:15:17.787 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:15:17.787 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestIO (52768 ms) 2024-09-11T14:15:17.787 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS1 2024-09-11T14:15:17.788 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:15:57.291 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:15:57.291 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:15:57.292 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:15:57.292 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:15:57.292 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:15:57.292 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.292 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:15:57.292 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.292 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.292 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:15:57.292 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.292 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:15:57.292 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.292 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.292 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:15:57.293 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.293 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:15:57.293 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.293 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.293 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:15:57.293 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.293 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:15:57.293 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.293 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.293 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:15:57.293 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.293 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:15:57.293 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.294 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.294 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:15:57.294 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:15:57.294 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:15:57.294 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:15:57.294 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:15:57.294 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:15:57.294 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:15:57.294 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:15:57.294 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:15:57.294 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:15:57.294 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:15:57.294 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.294 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:15:57.295 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.295 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.295 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:15:57.295 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.295 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:15:57.295 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.295 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.295 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:15:57.295 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.295 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:15:57.295 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.295 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.295 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:15:57.295 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.296 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:15:57.296 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.296 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.296 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:15:57.296 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.296 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:15:57.296 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.296 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.296 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:15:57.296 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:15:57.296 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:15:57.296 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:15:57.296 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:15:57.296 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:15:57.297 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.297 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:15:57.297 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:15:57.297 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:15:57.297 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.297 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:15:57.297 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:15:57.297 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:15:57.297 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.297 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:15:57.297 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:15:57.297 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:15:57.297 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.297 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:15:57.298 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:15:57.298 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:15:57.298 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.298 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:15:57.298 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:15:57.298 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:15:57.298 INFO:tasks.workunit.client.0.smithi150.stdout:discard: 512~512 = 512 2024-09-11T14:15:57.298 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.298 INFO:tasks.workunit.client.0.smithi150.stdout:aio discard: 1536~512 = 0 2024-09-11T14:15:57.298 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:15:57.298 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:15:57.298 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:15:57.298 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:15:57.298 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:15:57.299 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 0 2024-09-11T14:15:57.299 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.299 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.299 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 0 2024-09-11T14:15:57.299 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.299 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.299 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 16384 2024-09-11T14:15:57.299 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.299 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.299 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 16384 2024-09-11T14:15:57.299 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.299 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.299 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:57.299 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:57.300 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 49152 2024-09-11T14:15:57.300 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.300 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.300 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 49152 2024-09-11T14:15:57.300 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.300 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.300 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 65536 2024-09-11T14:15:57.300 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.300 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.300 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 65536 2024-09-11T14:15:57.300 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.300 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.300 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:57.300 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:57.301 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 98304 2024-09-11T14:15:57.301 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.301 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.301 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 98304 2024-09-11T14:15:57.301 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.301 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.301 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 114688 2024-09-11T14:15:57.301 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.301 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.301 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 114688 2024-09-11T14:15:57.301 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.301 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.301 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:57.301 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:57.302 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 147456 2024-09-11T14:15:57.302 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.302 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.302 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 147456 2024-09-11T14:15:57.302 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.302 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.302 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 163840 2024-09-11T14:15:57.302 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.302 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.302 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 163840 2024-09-11T14:15:57.302 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.302 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.302 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:57.303 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:57.303 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 196608 2024-09-11T14:15:57.303 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.303 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.303 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 196608 2024-09-11T14:15:57.303 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.303 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.303 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 212992 2024-09-11T14:15:57.303 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.303 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.303 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 212992 2024-09-11T14:15:57.303 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.303 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.303 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:57.303 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:57.304 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.304 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:57.304 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.304 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.304 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:57.304 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.304 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.304 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.304 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:57.304 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.304 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.304 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:57.304 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.305 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.305 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.305 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:57.305 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.305 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.305 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:57.305 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.305 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.305 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.306 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:57.306 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.306 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.306 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:57.306 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.306 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.306 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.306 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:57.306 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:57.306 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.306 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:57.306 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:15:57.306 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.307 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:57.307 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.307 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.307 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:57.307 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.307 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.307 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:15:57.307 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:15:57.307 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:15:57.307 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:15:57.307 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:15:57.307 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:15:57.307 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:15:57.307 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.025 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.026 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:16:33.026 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:16:33.026 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:16:33.026 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:16:33.026 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:16:33.026 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.026 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.026 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:16:33.026 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:16:33.026 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:16:33.027 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:16:33.027 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:16:33.027 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.027 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.027 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:16:33.027 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.027 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.027 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:16:33.027 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.027 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.027 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:16:33.027 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:16:33.027 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:16:33.027 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:16:33.028 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:16:33.028 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.028 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.028 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:16:33.028 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:16:33.028 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:16:33.028 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:16:33.028 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:16:33.028 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.028 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.028 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:16:33.028 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:16:33.028 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:16:33.029 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:16:33.029 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:16:33.029 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.029 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.029 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:16:33.029 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:16:33.029 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:16:33.029 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:16:33.029 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:16:33.029 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.029 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.029 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:16:33.029 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.030 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.030 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:16:33.030 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.030 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.030 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:16:33.030 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:16:33.030 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:16:33.030 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:16:33.030 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:16:33.030 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.030 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.030 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:16:33.030 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:16:33.030 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:16:33.030 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:16:33.031 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:16:33.031 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.031 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.031 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:16:33.031 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:16:33.031 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:16:33.031 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:16:33.031 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:16:33.031 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.031 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.031 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:16:33.031 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:16:33.031 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:16:33.031 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:16:33.032 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:16:33.032 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.032 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.032 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:16:33.032 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.032 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.032 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:16:33.032 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.032 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.032 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:16:33.032 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:16:33.032 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:16:33.033 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:16:33.033 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:16:33.033 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.033 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.033 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:16:33.033 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:16:33.033 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:16:33.033 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:16:33.033 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:16:33.033 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.033 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.033 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:16:33.033 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:16:33.033 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:16:33.034 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:16:33.034 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:16:33.034 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.034 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.034 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:16:33.034 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:16:33.034 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:16:33.034 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:16:33.034 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:16:33.034 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.034 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.034 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:16:33.034 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:16:33.034 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:16:33.035 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:16:33.035 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:16:33.035 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:16:33.035 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:16:33.035 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:16:33.035 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 4 2024-09-11T14:16:33.035 INFO:tasks.workunit.client.0.smithi150.stdout:read: 4 2024-09-11T14:16:33.035 INFO:tasks.workunit.client.0.smithi150.stdout:read: 4 2024-09-11T14:16:33.035 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS1 (75249 ms) 2024-09-11T14:16:33.035 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS2 2024-09-11T14:16:33.035 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:17:15.965 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:17:15.966 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:17:15.966 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:17:15.966 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:17:15.966 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:17:15.966 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.966 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:17:15.966 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.967 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.967 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:17:15.967 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.967 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:17:15.967 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.967 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.967 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:17:15.967 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.967 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:17:15.967 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.967 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.967 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:17:15.968 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.968 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:17:15.968 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.968 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.968 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:17:15.968 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.968 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:17:15.968 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.968 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.968 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:17:15.968 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:17:15.968 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:17:15.968 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:17:15.969 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:17:15.969 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:17:15.969 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:17:15.969 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:17:15.969 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:17:15.969 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:17:15.969 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:17:15.969 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.969 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:17:15.969 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.969 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.969 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:17:15.969 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.970 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:17:15.970 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.970 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.970 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:17:15.970 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.970 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:17:15.970 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.970 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.970 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:17:15.970 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.970 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:17:15.970 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.970 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.971 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:17:15.971 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.971 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:17:15.971 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.971 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.971 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:17:15.971 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:17:15.971 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:17:15.971 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:17:15.971 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:17:15.971 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:17:15.971 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.971 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:17:15.972 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:17:15.972 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:17:15.972 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.972 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:17:15.972 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:17:15.972 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:17:15.972 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.972 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:17:15.972 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:17:15.972 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:17:15.972 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.972 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:17:15.972 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:17:15.972 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:17:15.973 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.973 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:17:15.973 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:17:15.973 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:17:15.973 INFO:tasks.workunit.client.0.smithi150.stdout:discard: 512~512 = 512 2024-09-11T14:17:15.973 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.973 INFO:tasks.workunit.client.0.smithi150.stdout:aio discard: 1536~512 = 0 2024-09-11T14:17:15.973 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:17:15.973 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:17:15.973 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:17:15.973 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:17:15.973 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:17:15.974 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 0 2024-09-11T14:17:15.974 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.974 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.974 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 0 2024-09-11T14:17:15.974 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.974 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.974 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 16384 2024-09-11T14:17:15.974 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.974 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.974 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 16384 2024-09-11T14:17:15.974 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.974 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.974 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:15.975 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:15.975 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 49152 2024-09-11T14:17:15.975 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.975 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.975 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 49152 2024-09-11T14:17:15.975 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.975 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.975 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 65536 2024-09-11T14:17:15.975 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.975 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.975 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 65536 2024-09-11T14:17:15.975 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.975 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.976 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:15.976 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:15.976 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 98304 2024-09-11T14:17:15.976 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.976 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.976 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 98304 2024-09-11T14:17:15.976 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.976 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.976 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 114688 2024-09-11T14:17:15.976 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.976 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.976 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 114688 2024-09-11T14:17:15.976 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.977 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.977 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:15.977 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:15.977 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 147456 2024-09-11T14:17:15.977 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.977 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.977 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 147456 2024-09-11T14:17:15.977 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.977 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.977 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 163840 2024-09-11T14:17:15.977 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.977 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.977 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 163840 2024-09-11T14:17:15.977 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.978 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.978 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:15.978 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:15.978 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 196608 2024-09-11T14:17:15.978 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.978 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.978 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 196608 2024-09-11T14:17:15.978 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.978 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.978 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 212992 2024-09-11T14:17:15.978 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.978 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.978 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 212992 2024-09-11T14:17:15.978 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.979 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.979 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:15.979 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:15.979 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.979 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:15.979 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.979 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.979 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:15.979 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.979 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.979 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.979 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:15.980 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.980 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.980 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:15.980 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.980 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.980 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.980 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:15.980 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.980 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.980 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:15.980 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.980 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.980 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.980 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:15.981 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.981 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.981 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:15.981 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.981 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.981 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.981 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:15.981 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:15.981 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.981 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:15.981 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:15.981 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.982 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:15.982 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.982 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.982 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:15.982 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.982 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.982 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:15.982 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:15.982 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:15.982 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:15.982 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:15.982 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:15.982 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:15.982 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.365 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.365 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:51.365 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:51.365 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:51.366 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:51.366 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:51.366 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.366 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.366 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:51.366 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:51.366 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:51.366 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:51.366 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:51.366 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.366 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:51.368 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:51.368 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:51.368 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:51.368 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:51.368 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.368 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.368 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:51.368 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:51.368 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:51.368 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:51.368 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:51.368 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.368 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.369 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:51.369 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:51.369 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:51.369 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:51.369 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:51.369 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.369 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.369 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:51.369 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.369 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.369 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:51.369 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.369 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.370 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:51.370 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:51.370 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:51.370 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:51.370 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:51.370 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.370 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.370 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:51.370 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:51.370 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:51.370 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:51.370 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:51.371 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.371 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.371 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:51.371 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:51.371 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:51.371 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:51.371 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:51.371 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.371 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.371 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:51.371 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:51.371 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:51.371 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:51.372 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:51.372 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.372 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.372 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:51.372 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.372 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.372 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:51.372 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.372 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.372 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:51.372 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:51.372 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:51.373 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:51.373 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:51.373 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.373 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.373 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:51.373 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:51.373 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:51.373 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:51.373 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:51.373 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.373 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.373 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:51.373 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:51.374 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:51.374 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:51.374 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:51.374 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.374 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.374 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:17:51.374 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:17:51.374 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:17:51.374 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:17:51.374 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:17:51.374 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.374 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.374 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:51.375 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:17:51.375 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:17:51.375 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:17:51.375 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:17:51.375 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:17:51.375 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:17:51.375 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:17:51.375 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 4 2024-09-11T14:17:51.375 INFO:tasks.workunit.client.0.smithi150.stdout:read: 4 2024-09-11T14:17:51.375 INFO:tasks.workunit.client.0.smithi150.stdout:read: 4 2024-09-11T14:17:51.375 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS2 (78339 ms) 2024-09-11T14:17:51.375 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCloneEncryption 2024-09-11T14:17:51.375 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:2471: Skipped 2024-09-11T14:17:51.376 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:17:51.376 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestCloneEncryption (0 ms) 2024-09-11T14:17:51.376 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.LUKS1UnderLUKS2WithoutResize 2024-09-11T14:17:51.376 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:2659: Skipped 2024-09-11T14:17:51.376 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:17:51.376 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.LUKS1UnderLUKS2WithoutResize (0 ms) 2024-09-11T14:17:51.376 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.LUKS2UnderLUKS1WithoutResize 2024-09-11T14:17:51.376 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:2735: Skipped 2024-09-11T14:17:51.376 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:17:51.376 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.LUKS2UnderLUKS1WithoutResize (0 ms) 2024-09-11T14:17:51.376 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.EncryptionFormatNoData 2024-09-11T14:17:51.376 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:17:55.879 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.EncryptionFormatNoData (4516 ms) 2024-09-11T14:17:55.880 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadSize 2024-09-11T14:17:55.880 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:18:01.866 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.EncryptionLoadBadSize (5986 ms) 2024-09-11T14:18:01.866 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-11T14:18:01.866 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:2905: Skipped 2024-09-11T14:18:01.866 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:18:01.866 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern (0 ms) 2024-09-11T14:18:01.866 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.EncryptionLoadFormatMismatch 2024-09-11T14:18:01.866 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:2985: Skipped 2024-09-11T14:18:01.867 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:18:01.867 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadFormatMismatch (0 ms) 2024-09-11T14:18:01.867 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.EncryptedResize 2024-09-11T14:18:01.867 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:18:14.885 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.EncryptedResize (13019 ms) 2024-09-11T14:18:14.885 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.EncryptedFlattenSmallData 2024-09-11T14:18:14.885 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3202: Skipped 2024-09-11T14:18:14.885 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:18:14.885 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.EncryptedFlattenSmallData (0 ms) 2024-09-11T14:18:14.885 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestIOWithIOHint 2024-09-11T14:18:14.885 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:18:42.507 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:18:42.508 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:18:42.508 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:18:42.508 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:18:42.508 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:18:42.508 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.508 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:18:42.508 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.508 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.509 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:18:42.509 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.509 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:18:42.509 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.509 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.509 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:18:42.509 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.509 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:18:42.509 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.509 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.509 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:18:42.509 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.509 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:18:42.510 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.510 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.510 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:18:42.510 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.510 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:18:42.510 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.510 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.510 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:18:42.510 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:18:42.510 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:18:42.510 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:18:42.510 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:18:42.510 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:18:42.511 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:18:42.511 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:18:42.511 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:18:42.511 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:18:42.511 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:18:42.511 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.511 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:18:42.511 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.511 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.511 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:18:42.511 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.511 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:18:42.511 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.512 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.512 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:18:42.512 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.512 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:18:42.512 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.512 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.512 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:18:42.512 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.512 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:18:42.512 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.512 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.512 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:18:42.512 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.513 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:18:42.513 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.513 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.513 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:18:42.513 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:18:42.513 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:18:42.513 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:18:42.513 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:18:42.513 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:18:42.513 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.513 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:18:42.513 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:18:42.513 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:18:42.513 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.514 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:18:42.514 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:18:42.514 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:18:42.514 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.514 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:18:42.514 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:18:42.514 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:18:42.514 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.514 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:18:42.514 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:18:42.514 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:18:42.514 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.514 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:18:42.514 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:18:42.515 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:18:42.515 INFO:tasks.workunit.client.0.smithi150.stdout:discard: 512~512 = 512 2024-09-11T14:18:42.515 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.515 INFO:tasks.workunit.client.0.smithi150.stdout:aio discard: 1536~512 = 0 2024-09-11T14:18:42.515 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:18:42.515 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:18:42.515 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:18:42.515 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:18:42.515 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:18:42.515 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 0 2024-09-11T14:18:42.515 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.515 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.515 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 0 2024-09-11T14:18:42.515 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.516 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.516 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 16384 2024-09-11T14:18:42.516 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.516 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.516 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 16384 2024-09-11T14:18:42.516 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.516 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.516 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:18:42.516 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:18:42.516 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 49152 2024-09-11T14:18:42.516 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.516 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.516 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 49152 2024-09-11T14:18:42.516 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.517 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.517 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 65536 2024-09-11T14:18:42.517 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.517 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.517 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 65536 2024-09-11T14:18:42.517 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.517 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.517 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:18:42.518 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:18:42.518 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 98304 2024-09-11T14:18:42.518 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.518 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.518 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 98304 2024-09-11T14:18:42.518 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.518 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.518 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 114688 2024-09-11T14:18:42.518 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.518 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.518 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 114688 2024-09-11T14:18:42.518 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.518 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.518 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:18:42.519 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:18:42.519 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 147456 2024-09-11T14:18:42.519 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.519 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.519 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 147456 2024-09-11T14:18:42.519 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.519 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.519 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 163840 2024-09-11T14:18:42.519 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.519 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.519 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 163840 2024-09-11T14:18:42.519 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.519 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.519 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:18:42.520 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:18:42.520 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 196608 2024-09-11T14:18:42.520 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.520 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.520 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 196608 2024-09-11T14:18:42.520 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.520 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.520 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 212992 2024-09-11T14:18:42.520 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.520 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.520 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 212992 2024-09-11T14:18:42.520 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.520 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.521 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:18:42.521 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:18:42.521 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.521 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:18:42.521 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.521 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.521 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:18:42.521 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.521 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.521 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.521 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:18:42.521 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.522 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.522 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:18:42.522 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.522 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.522 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.522 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:18:42.522 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.522 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.522 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:18:42.522 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.522 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.523 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.523 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:18:42.523 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.523 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.523 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:18:42.523 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.523 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.523 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.523 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:18:42.523 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:18:42.523 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.523 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:18:42.523 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:18:42.524 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.524 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:18:42.524 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.524 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.524 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:18:42.524 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.524 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.524 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:18:42.524 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:18:42.524 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:18:42.524 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:18:42.524 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:18:42.524 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:18:42.525 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:18:42.525 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.337 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.338 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:06.338 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:06.338 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:06.338 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:06.338 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:06.338 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.338 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.338 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:06.338 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:06.338 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:06.338 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:06.338 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:06.338 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.339 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.339 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:06.339 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.339 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.339 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:06.339 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.339 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.339 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:06.339 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:06.339 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:06.339 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:06.339 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:06.340 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.340 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.340 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:06.340 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:06.340 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:06.340 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:06.340 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:06.340 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.340 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.340 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:06.340 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:06.340 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:06.340 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:06.340 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:06.340 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.341 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.341 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:06.341 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:06.341 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:06.341 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:06.341 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:06.341 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.341 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.341 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:06.341 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.341 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.341 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:06.341 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.341 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.342 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:06.342 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:06.342 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:06.342 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:06.342 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:06.342 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.342 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.342 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:06.342 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:06.342 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:06.342 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:06.342 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:06.342 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.343 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.343 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:06.343 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:06.343 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:06.343 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:06.343 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:06.343 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.343 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.343 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:06.343 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:06.343 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:06.343 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:06.343 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:06.343 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.344 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.344 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:06.344 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.344 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.344 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:06.344 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.344 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.344 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:06.344 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:06.344 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:06.344 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:06.344 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:06.345 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.345 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.345 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:06.345 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:06.345 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:06.345 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:06.345 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:06.345 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.345 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.345 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:06.346 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:06.346 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:06.346 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:06.346 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:06.346 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.346 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.346 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:06.346 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:06.346 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:06.346 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:06.346 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:06.346 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.347 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.347 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:06.347 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:06.347 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:06.347 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:06.347 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:19:06.347 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:19:06.347 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:19:06.347 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestIOWithIOHint (51452 ms) 2024-09-11T14:19:06.347 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestDataPoolIO 2024-09-11T14:19:06.347 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3947: Skipped 2024-09-11T14:19:06.347 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:19:06.347 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestDataPoolIO (0 ms) 2024-09-11T14:19:06.348 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatch 2024-09-11T14:19:06.348 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:06.518 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatch (181 ms) 2024-09-11T14:19:06.518 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatch 2024-09-11T14:19:06.518 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:06.734 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatch (217 ms) 2024-09-11T14:19:06.734 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccess 2024-09-11T14:19:06.734 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:06.909 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccess (174 ms) 2024-09-11T14:19:06.909 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccess 2024-09-11T14:19:06.909 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:07.084 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccess (175 ms) 2024-09-11T14:19:07.084 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned 2024-09-11T14:19:07.084 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:07.871 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned (787 ms) 2024-09-11T14:19:07.871 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned 2024-09-11T14:19:07.871 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:08.511 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned (640 ms) 2024-09-11T14:19:08.511 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLarge 2024-09-11T14:19:08.511 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:08.930 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLarge (419 ms) 2024-09-11T14:19:08.930 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLarge 2024-09-11T14:19:08.930 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:09.419 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLarge (490 ms) 2024-09-11T14:19:09.419 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess 2024-09-11T14:19:09.420 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:13.756 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess (4337 ms) 2024-09-11T14:19:13.756 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess 2024-09-11T14:19:13.757 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:18.040 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess (4284 ms) 2024-09-11T14:19:18.041 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers 2024-09-11T14:19:18.041 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:18.198 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers (158 ms) 2024-09-11T14:19:18.199 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVMismatch 2024-09-11T14:19:18.199 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:18.404 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVMismatch (205 ms) 2024-09-11T14:19:18.404 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVSuccess 2024-09-11T14:19:18.404 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:18.596 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVSuccess (193 ms) 2024-09-11T14:19:18.597 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestScatterGatherIO 2024-09-11T14:19:18.597 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:18.760 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestScatterGatherIO (164 ms) 2024-09-11T14:19:18.761 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestEmptyDiscard 2024-09-11T14:19:18.761 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:18.907 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:18.907 INFO:tasks.workunit.client.0.smithi150.stdout:aio discard: 0~1048576 = 0 2024-09-11T14:19:18.907 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:18.907 INFO:tasks.workunit.client.0.smithi150.stdout:aio discard: 0~4194304 = 0 2024-09-11T14:19:18.907 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:18.907 INFO:tasks.workunit.client.0.smithi150.stdout:aio discard: 3145728~1048576 = 0 2024-09-11T14:19:18.907 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestEmptyDiscard (146 ms) 2024-09-11T14:19:18.908 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestFUA 2024-09-11T14:19:18.908 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:19.504 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:19:19.505 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:19:19.505 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:19:19.505 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:19:19.505 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:19:19.505 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:19:19.505 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:19:19.505 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:19:19.505 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:19:19.505 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:19:19.505 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.505 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:19:19.505 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:19.506 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:19.506 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:19:19.506 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.506 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:19:19.506 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:19.506 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:19.506 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:19:19.506 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.506 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:19:19.506 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:19.506 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:19.506 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:19:19.506 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.506 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:19:19.506 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:19.507 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:19.507 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:19:19.507 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.507 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:19:19.507 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:19.507 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:19.507 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:19:19.507 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.507 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:19:19.507 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:19:19.507 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:19:19.507 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.507 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:19:19.507 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:19:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:19:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:19:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:19:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:19:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:19:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:19:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:19:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:19:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:19:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:19:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestFUA (598 ms) 2024-09-11T14:19:19.509 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestIOPP 2024-09-11T14:19:19.509 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:19:19.607 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:19:19.607 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:19:19.607 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:19:19.607 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:19:19.607 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:19:19.607 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.607 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:19:19.607 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:19.607 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:19.607 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:19:19.607 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.608 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:19:19.608 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:19.608 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:19.608 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:19:19.608 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.608 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:19:19.608 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:19.608 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:19.608 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:19:19.608 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.608 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:19:19.608 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:19.608 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:19.608 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:19:19.609 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.609 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:19:19.609 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:19.864 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:19.864 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:19:19.864 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:19:19.865 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:19:19.865 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:19:19.865 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:19:19.865 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:19:19.865 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:19:19.865 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:19:19.865 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:19:19.865 INFO:tasks.workunit.client.0.smithi150.stdout:start compare and write 2024-09-11T14:19:19.865 INFO:tasks.workunit.client.0.smithi150.stdout:compare and wrote: 512 2024-09-11T14:19:19.865 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.865 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:19:19.865 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:19.881 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:19.881 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:19:19.881 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.881 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:19:19.881 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:19.900 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:19.900 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:19:19.900 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.900 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:19:19.900 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:19.919 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:19.919 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:19:19.919 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.919 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:19:19.919 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:19.938 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:19.938 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:19:19.938 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.938 INFO:tasks.workunit.client.0.smithi150.stdout:started aio compare and write 2024-09-11T14:19:19.938 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:19.982 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:19.982 INFO:tasks.workunit.client.0.smithi150.stdout:finished aio compare and write 2024-09-11T14:19:19.982 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:19:19.982 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:19:19.982 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:19:19.983 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:19:19.983 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:19:19.983 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.983 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:19:19.983 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:19:19.988 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:19:19.989 INFO:tasks.workunit.client.0.smithi150.stdout:finished read 2024-09-11T14:19:19.989 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.989 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:19:19.989 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:19:19.995 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:19:19.995 INFO:tasks.workunit.client.0.smithi150.stdout:finished read 2024-09-11T14:19:19.995 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:19.995 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:19:19.995 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:19:20.001 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:19:20.001 INFO:tasks.workunit.client.0.smithi150.stdout:finished read 2024-09-11T14:19:20.001 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:20.001 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:19:20.002 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:19:20.008 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:19:20.008 INFO:tasks.workunit.client.0.smithi150.stdout:finished read 2024-09-11T14:19:20.008 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:20.008 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:19:20.008 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:19:20.008 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:19:20.008 INFO:tasks.workunit.client.0.smithi150.stdout:finished read 2024-09-11T14:19:20.008 INFO:tasks.workunit.client.0.smithi150.stdout:discard: 512~512 2024-09-11T14:19:20.008 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:44.159 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:19:44.160 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:19:44.160 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:19:44.160 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:19:44.160 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:19:44.160 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 0 2024-09-11T14:19:44.160 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.160 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.160 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 0 2024-09-11T14:19:44.161 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.161 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.161 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 16384 2024-09-11T14:19:44.161 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.161 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.161 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 16384 2024-09-11T14:19:44.161 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.161 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.161 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:44.161 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:44.161 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 49152 2024-09-11T14:19:44.162 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.162 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.162 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 49152 2024-09-11T14:19:44.162 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.162 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.162 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 65536 2024-09-11T14:19:44.162 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.162 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.162 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 65536 2024-09-11T14:19:44.162 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.163 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.163 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:44.163 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:44.163 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 98304 2024-09-11T14:19:44.163 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.163 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.163 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 98304 2024-09-11T14:19:44.163 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.163 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.163 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 114688 2024-09-11T14:19:44.163 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.164 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.164 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 114688 2024-09-11T14:19:44.164 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.164 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.164 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:44.164 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:44.164 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 147456 2024-09-11T14:19:44.164 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.164 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.164 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 147456 2024-09-11T14:19:44.164 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.164 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.165 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 163840 2024-09-11T14:19:44.165 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.165 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.165 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 163840 2024-09-11T14:19:44.165 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.165 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.165 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:44.165 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:44.165 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 196608 2024-09-11T14:19:44.165 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.165 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.165 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 196608 2024-09-11T14:19:44.166 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.166 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.166 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 212992 2024-09-11T14:19:44.166 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.166 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.166 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 212992 2024-09-11T14:19:44.166 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.166 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.166 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:44.166 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:44.166 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:44.167 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:44.167 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:44.167 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:44.167 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:44.167 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.167 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.167 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:44.167 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:44.168 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:44.168 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:44.168 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:44.168 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.168 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.168 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:44.168 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:44.168 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:44.382 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:44.382 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:44.382 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.382 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.382 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:44.382 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:44.383 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:44.540 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:44.540 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:44.541 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:44.541 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:44.541 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:44.541 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:44.541 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:44.541 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:44.541 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:44.541 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:44.541 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:44.541 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:44.541 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:45.184 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:45.184 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:45.185 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:45.185 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:45.185 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:45.185 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:45.185 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:45.639 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:45.639 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:45.640 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:45.640 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:45.640 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:45.640 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:45.640 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:46.499 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:46.499 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:46.499 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:46.499 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:46.499 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:46.499 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:46.499 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:47.097 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:47.097 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:47.098 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:47.098 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:47.098 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:47.098 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:47.098 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:47.098 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:47.098 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:47.098 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:47.098 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:47.098 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:47.098 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:48.437 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:48.438 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:48.438 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:48.438 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:48.438 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:48.438 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:48.438 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:49.307 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:49.307 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:49.307 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:49.307 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:49.307 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:49.307 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:49.307 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:50.968 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:50.969 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:50.969 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:50.969 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:50.969 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:50.969 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:50.969 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:52.003 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:52.003 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:52.003 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:52.003 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:52.003 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:52.003 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:52.003 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:52.003 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:52.003 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:52.003 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:52.003 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:52.003 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:52.003 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:53.897 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:53.897 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:53.897 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:53.897 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:53.897 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:53.897 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:53.897 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:55.213 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:55.213 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:55.213 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:55.213 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:55.213 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:55.213 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:55.214 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:57.397 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:57.398 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:57.398 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:57.398 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:57.398 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:57.398 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:57.398 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:19:58.981 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:19:58.981 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:19:58.981 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:19:58.981 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:19:58.982 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:58.982 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:58.982 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:58.982 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:58.982 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:58.982 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:19:58.982 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:19:58.982 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:19:58.982 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:01.552 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:01.552 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:01.552 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:01.552 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:01.552 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:01.552 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:01.552 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:03.301 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:03.301 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:03.301 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:03.301 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:03.301 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:03.301 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:03.302 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:06.202 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:06.202 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:06.202 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:06.203 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:06.203 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:06.203 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:06.203 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:08.181 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:08.182 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:08.182 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:08.182 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:08.182 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:08.182 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:08.182 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:08.182 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:08.183 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:08.183 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:08.183 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestIOPP (48677 ms) 2024-09-11T14:20:08.183 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP 2024-09-11T14:20:08.183 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:08.323 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP (141 ms) 2024-09-11T14:20:08.323 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP 2024-09-11T14:20:08.323 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:08.478 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP (155 ms) 2024-09-11T14:20:08.478 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP 2024-09-11T14:20:08.478 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:08.620 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP (142 ms) 2024-09-11T14:20:08.620 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP 2024-09-11T14:20:08.620 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:08.760 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP (140 ms) 2024-09-11T14:20:08.760 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchPP 2024-09-11T14:20:08.760 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:08.934 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchPP (175 ms) 2024-09-11T14:20:08.934 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchPP 2024-09-11T14:20:08.934 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:09.068 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:09.104 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchPP (170 ms) 2024-09-11T14:20:09.104 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-11T14:20:09.104 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:09.272 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP (168 ms) 2024-09-11T14:20:09.273 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-11T14:20:09.273 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:09.449 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:09.483 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP (211 ms) 2024-09-11T14:20:09.483 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessPP 2024-09-11T14:20:09.483 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:09.657 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessPP (174 ms) 2024-09-11T14:20:09.658 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessPP 2024-09-11T14:20:09.658 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:09.800 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:09.832 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessPP (175 ms) 2024-09-11T14:20:09.833 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-11T14:20:09.833 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:10.026 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP (193 ms) 2024-09-11T14:20:10.026 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-11T14:20:10.026 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:10.205 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:10.250 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP (225 ms) 2024-09-11T14:20:10.250 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP 2024-09-11T14:20:10.250 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:10.803 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP (552 ms) 2024-09-11T14:20:10.803 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP 2024-09-11T14:20:10.803 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:11.082 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:11.534 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP (732 ms) 2024-09-11T14:20:11.535 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLargePP 2024-09-11T14:20:11.535 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:12.089 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLargePP (554 ms) 2024-09-11T14:20:12.089 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLargePP 2024-09-11T14:20:12.089 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:12.376 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:12.588 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLargePP (500 ms) 2024-09-11T14:20:12.589 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP 2024-09-11T14:20:12.589 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:17.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP (4544 ms) 2024-09-11T14:20:17.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP 2024-09-11T14:20:17.133 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:21.167 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:21.688 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP (4555 ms) 2024-09-11T14:20:21.688 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestIOPPWithIOHint 2024-09-11T14:20:21.688 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:20:21.912 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:20:21.912 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:20:21.912 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:20:21.912 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:20:21.912 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:20:21.912 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:21.912 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:20:21.912 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:21.928 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:21.928 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:20:21.928 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:21.929 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:20:21.929 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:21.945 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:21.946 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:20:21.946 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:21.946 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:20:21.946 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:21.962 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:21.962 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:20:21.962 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:21.963 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:20:21.963 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:21.980 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:21.980 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:20:21.980 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:21.980 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:20:21.980 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:22.001 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:22.001 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:20:22.001 INFO:tasks.workunit.client.0.smithi150.stdout:read: 512 2024-09-11T14:20:22.001 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:22.001 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:20:22.001 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:20:22.007 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:20:22.007 INFO:tasks.workunit.client.0.smithi150.stdout:finished read 2024-09-11T14:20:22.007 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:22.007 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:20:22.007 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:20:22.013 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:20:22.013 INFO:tasks.workunit.client.0.smithi150.stdout:finished read 2024-09-11T14:20:22.014 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:22.014 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:20:22.014 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:20:22.032 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:20:22.032 INFO:tasks.workunit.client.0.smithi150.stdout:finished read 2024-09-11T14:20:22.032 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:22.032 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:20:22.033 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:20:22.039 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:20:22.039 INFO:tasks.workunit.client.0.smithi150.stdout:finished read 2024-09-11T14:20:22.040 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:22.040 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:20:22.040 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:20:46.042 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:20:46.043 INFO:tasks.workunit.client.0.smithi150.stdout:finished read 2024-09-11T14:20:46.043 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 0 2024-09-11T14:20:46.043 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.043 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.043 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 0 2024-09-11T14:20:46.043 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.043 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.043 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 16384 2024-09-11T14:20:46.043 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.043 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.043 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 16384 2024-09-11T14:20:46.043 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.044 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.044 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:46.044 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:46.044 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 49152 2024-09-11T14:20:46.044 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.044 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.044 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 49152 2024-09-11T14:20:46.044 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.044 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.044 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 65536 2024-09-11T14:20:46.044 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.044 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.044 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 65536 2024-09-11T14:20:46.044 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.045 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.045 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:46.045 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:46.045 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 98304 2024-09-11T14:20:46.045 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.045 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.045 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 98304 2024-09-11T14:20:46.045 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.045 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.045 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 114688 2024-09-11T14:20:46.045 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.045 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.045 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 114688 2024-09-11T14:20:46.045 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.046 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.046 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:46.046 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:46.046 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 147456 2024-09-11T14:20:46.046 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.046 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.046 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 147456 2024-09-11T14:20:46.046 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.046 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.046 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 163840 2024-09-11T14:20:46.046 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.046 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.046 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 163840 2024-09-11T14:20:46.046 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.046 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.047 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:46.047 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:46.047 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 196608 2024-09-11T14:20:46.047 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.047 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.047 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 196608 2024-09-11T14:20:46.047 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.047 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.047 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 212992 2024-09-11T14:20:46.047 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.047 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.047 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 212992 2024-09-11T14:20:46.047 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.047 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.048 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:46.048 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:46.048 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:46.048 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:46.048 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:46.048 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:46.048 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:46.048 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.048 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.048 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:46.048 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:46.048 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:46.066 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:46.066 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:46.066 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.066 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.067 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:46.067 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:46.067 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:46.293 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:46.293 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:46.293 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.293 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.293 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:46.294 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:46.294 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:46.480 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:46.480 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:46.480 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:46.480 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:46.480 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:46.480 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:46.480 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:46.481 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:46.481 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:46.481 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:46.481 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:46.481 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:46.481 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:47.142 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:47.143 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:47.143 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:47.143 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:47.143 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:47.143 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:47.143 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:47.628 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:47.628 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:47.628 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:47.628 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:47.628 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:47.628 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:47.628 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:48.468 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:48.468 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:48.468 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:48.468 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:48.468 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:48.469 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:48.469 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:49.152 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:49.152 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:49.152 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:49.152 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:49.152 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:49.152 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:49.152 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:49.152 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:49.152 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:49.152 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:49.153 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:49.153 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:49.153 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:50.436 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:50.436 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:50.436 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:50.436 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:50.436 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:50.436 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:50.436 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:51.366 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:51.367 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:52.867 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:52.867 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:52.867 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:52.867 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:52.867 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:52.867 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:52.867 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:53.957 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:53.957 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:53.958 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:53.958 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:53.958 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:53.958 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:53.958 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:53.958 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:53.958 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:53.958 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:20:53.958 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:53.958 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:53.958 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:55.909 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:55.909 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:55.909 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:55.909 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:55.910 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:55.910 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:55.910 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:57.233 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:57.233 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:57.233 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:57.234 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:57.234 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:57.234 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:57.234 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:20:59.428 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:20:59.428 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:20:59.428 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:20:59.428 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:20:59.428 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:20:59.428 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:20:59.428 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:21:00.875 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:21:00.875 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:21:00.875 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:21:00.875 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:21:00.875 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:00.875 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:21:00.875 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:21:00.875 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:00.875 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:21:00.876 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:21:00.876 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:00.876 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:21:00.876 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:21:03.548 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:21:03.548 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:21:03.548 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:21:03.548 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:21:03.548 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:03.548 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:21:03.548 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:21:05.310 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:21:05.310 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:21:05.310 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:21:05.311 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:21:05.311 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:05.311 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:21:05.311 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:21:08.115 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:21:08.115 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:21:08.115 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:21:08.115 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:21:08.115 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:08.115 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:21:08.116 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:21:10.041 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:21:10.042 INFO:tasks.workunit.client.0.smithi150.stdout:finished writesame 2024-09-11T14:21:10.042 INFO:tasks.workunit.client.0.smithi150.stdout:to verify the data 2024-09-11T14:21:10.042 INFO:tasks.workunit.client.0.smithi150.stdout:verified 2024-09-11T14:21:10.042 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:10.042 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:21:10.042 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:21:10.042 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:10.042 INFO:tasks.workunit.client.0.smithi150.stdout:started writesame 2024-09-11T14:21:10.042 INFO:tasks.workunit.client.0.smithi150.stdout:expected fail, finished writesame 2024-09-11T14:21:10.042 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestIOPPWithIOHint (48354 ms) 2024-09-11T14:21:10.042 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestIOToSnapshot 2024-09-11T14:21:10.042 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:12.432 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 0 2024-09-11T14:21:12.432 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 0 2024-09-11T14:21:12.432 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 1 2024-09-11T14:21:12.432 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 1 2024-09-11T14:21:12.432 INFO:tasks.workunit.client.0.smithi150.stdout:snap: orig 2024-09-11T14:21:12.432 INFO:tasks.workunit.client.0.smithi150.stdout:found orig with size 2097152 2024-09-11T14:21:12.432 INFO:tasks.workunit.client.0.smithi150.stdout:read: 80 2024-09-11T14:21:12.432 INFO:tasks.workunit.client.0.smithi150.stdout:write test data! 2024-09-11T14:21:12.432 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 80 2024-09-11T14:21:12.432 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 2 2024-09-11T14:21:12.433 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 2 2024-09-11T14:21:12.433 INFO:tasks.workunit.client.0.smithi150.stdout:snap: orig 2024-09-11T14:21:12.433 INFO:tasks.workunit.client.0.smithi150.stdout:snap: written 2024-09-11T14:21:12.433 INFO:tasks.workunit.client.0.smithi150.stdout:found orig with size 2097152 2024-09-11T14:21:12.433 INFO:tasks.workunit.client.0.smithi150.stdout:found written with size 2097152 2024-09-11T14:21:12.433 INFO:tasks.workunit.client.0.smithi150.stdout:read: 80 2024-09-11T14:21:12.433 INFO:tasks.workunit.client.0.smithi150.stdout:read: 80 2024-09-11T14:21:12.433 INFO:tasks.workunit.client.0.smithi150.stdout:read: 80 2024-09-11T14:21:12.433 INFO:tasks.workunit.client.0.smithi150.stdout:write to snapshot returned -30 2024-09-11T14:21:12.433 INFO:tasks.workunit.client.0.smithi150.stdout:Read-only file system 2024-09-11T14:21:12.625 INFO:tasks.workunit.client.0.smithi150.stdout:read: 80 2024-09-11T14:21:12.625 INFO:tasks.workunit.client.0.smithi150.stdout:read: 80 2024-09-11T14:21:12.625 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 80 2024-09-11T14:21:12.625 INFO:tasks.workunit.client.0.smithi150.stdout:opening testimg@orig 2024-09-11T14:21:12.625 INFO:tasks.workunit.client.0.smithi150.stdout:read: 80 2024-09-11T14:21:12.625 INFO:tasks.workunit.client.0.smithi150.stdout:write to snapshot returned -30 2024-09-11T14:21:12.625 INFO:tasks.workunit.client.0.smithi150.stdout:Read-only file system 2024-09-11T14:21:14.408 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 2 2024-09-11T14:21:14.408 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 2 2024-09-11T14:21:14.408 INFO:tasks.workunit.client.0.smithi150.stdout:snap: orig 2024-09-11T14:21:14.408 INFO:tasks.workunit.client.0.smithi150.stdout:snap: written 2024-09-11T14:21:14.408 INFO:tasks.workunit.client.0.smithi150.stdout:found orig with size 2097152 2024-09-11T14:21:14.409 INFO:tasks.workunit.client.0.smithi150.stdout:found written with size 2097152 2024-09-11T14:21:14.409 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 1 2024-09-11T14:21:14.409 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 1 2024-09-11T14:21:14.409 INFO:tasks.workunit.client.0.smithi150.stdout:snap: orig 2024-09-11T14:21:14.409 INFO:tasks.workunit.client.0.smithi150.stdout:found orig with size 2097152 2024-09-11T14:21:14.409 INFO:tasks.workunit.client.0.smithi150.stdout:num snaps is: 0 2024-09-11T14:21:14.409 INFO:tasks.workunit.client.0.smithi150.stdout:expected: 0 2024-09-11T14:21:14.409 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestIOToSnapshot (4366 ms) 2024-09-11T14:21:14.409 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestSnapshotDeletedIo 2024-09-11T14:21:14.409 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:16.403 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestSnapshotDeletedIo (1995 ms) 2024-09-11T14:21:16.403 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestClone 2024-09-11T14:21:16.403 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:6444: Skipped 2024-09-11T14:21:16.403 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:16.403 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestClone (0 ms) 2024-09-11T14:21:16.403 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestClone2 2024-09-11T14:21:16.404 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:6608: Skipped 2024-09-11T14:21:16.404 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:16.404 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestClone2 (0 ms) 2024-09-11T14:21:16.404 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ListChildren 2024-09-11T14:21:16.404 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:6841: Skipped 2024-09-11T14:21:16.404 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:16.404 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ListChildren (0 ms) 2024-09-11T14:21:16.404 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ListChildrenTiered 2024-09-11T14:21:16.404 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:6995: Skipped 2024-09-11T14:21:16.404 INFO:tasks.workunit.client.0.smithi150.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:21:16.404 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered (0 ms) 2024-09-11T14:21:16.404 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.LockingPP 2024-09-11T14:21:16.404 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:16.938 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.LockingPP (535 ms) 2024-09-11T14:21:16.938 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.FlushAio 2024-09-11T14:21:16.938 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:20.930 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.FlushAio (3992 ms) 2024-09-11T14:21:20.931 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.FlushAioPP 2024-09-11T14:21:20.931 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:25.156 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.FlushAioPP (4226 ms) 2024-09-11T14:21:25.156 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ZeroLengthWrite 2024-09-11T14:21:25.156 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:25.298 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.ZeroLengthWrite (143 ms) 2024-09-11T14:21:25.298 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ZeroLengthDiscard 2024-09-11T14:21:25.299 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:25.476 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.ZeroLengthDiscard (177 ms) 2024-09-11T14:21:25.476 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ZeroLengthRead 2024-09-11T14:21:25.476 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:25.695 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.ZeroLengthRead (220 ms) 2024-09-11T14:21:25.695 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.LargeCacheRead 2024-09-11T14:21:25.695 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:25.960 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.LargeCacheRead (264 ms) 2024-09-11T14:21:25.960 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestPendingAio 2024-09-11T14:21:25.961 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9152: Skipped 2024-09-11T14:21:25.961 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:25.961 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestPendingAio (0 ms) 2024-09-11T14:21:25.961 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyup 2024-09-11T14:21:25.961 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9264: Skipped 2024-09-11T14:21:25.961 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:25.961 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyup (0 ms) 2024-09-11T14:21:25.961 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-09-11T14:21:25.962 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9325: Skipped 2024-09-11T14:21:25.962 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:25.962 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyupMismatch (0 ms) 2024-09-11T14:21:25.962 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.Flatten 2024-09-11T14:21:25.962 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9336: Skipped 2024-09-11T14:21:25.962 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:25.962 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.Flatten (0 ms) 2024-09-11T14:21:25.963 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.Sparsify 2024-09-11T14:21:25.963 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:26.186 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 32768 2024-09-11T14:21:26.186 INFO:tasks.workunit.client.0.smithi150.stdout:read: 32768 2024-09-11T14:21:26.186 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.Sparsify (226 ms) 2024-09-11T14:21:26.186 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.SparsifyPP 2024-09-11T14:21:26.186 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:26.437 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.SparsifyPP (251 ms) 2024-09-11T14:21:26.437 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.SnapshotLimit 2024-09-11T14:21:26.437 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:30.914 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.SnapshotLimit (4478 ms) 2024-09-11T14:21:30.915 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.SnapshotLimitPP 2024-09-11T14:21:30.915 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:36.186 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.SnapshotLimitPP (5270 ms) 2024-09-11T14:21:36.186 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-09-11T14:21:36.186 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9523: Skipped 2024-09-11T14:21:36.186 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.186 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.RebuildObjectMapViaLockOwner (0 ms) 2024-09-11T14:21:36.187 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.RenameViaLockOwner 2024-09-11T14:21:36.187 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9575: Skipped 2024-09-11T14:21:36.187 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.187 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.RenameViaLockOwner (0 ms) 2024-09-11T14:21:36.187 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.SnapCreateViaLockOwner 2024-09-11T14:21:36.187 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9615: Skipped 2024-09-11T14:21:36.187 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.187 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SnapCreateViaLockOwner (0 ms) 2024-09-11T14:21:36.187 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.SnapRemoveViaLockOwner 2024-09-11T14:21:36.187 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9659: Skipped 2024-09-11T14:21:36.187 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.187 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveViaLockOwner (0 ms) 2024-09-11T14:21:36.188 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-09-11T14:21:36.188 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9699: Skipped 2024-09-11T14:21:36.188 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.188 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.UpdateFeaturesViaLockOwner (0 ms) 2024-09-11T14:21:36.188 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-11T14:21:36.188 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9736: Skipped 2024-09-11T14:21:36.188 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.188 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner (0 ms) 2024-09-11T14:21:36.188 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.SnapRemove2 2024-09-11T14:21:36.188 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9777: Skipped 2024-09-11T14:21:36.188 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.189 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SnapRemove2 (0 ms) 2024-09-11T14:21:36.189 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.SnapRenameViaLockOwner 2024-09-11T14:21:36.189 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9823: Skipped 2024-09-11T14:21:36.189 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.189 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SnapRenameViaLockOwner (0 ms) 2024-09-11T14:21:36.189 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.SnapProtectViaLockOwner 2024-09-11T14:21:36.189 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9864: Skipped 2024-09-11T14:21:36.189 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.189 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SnapProtectViaLockOwner (0 ms) 2024-09-11T14:21:36.189 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.SnapUnprotectViaLockOwner 2024-09-11T14:21:36.189 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9905: Skipped 2024-09-11T14:21:36.189 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.190 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SnapUnprotectViaLockOwner (0 ms) 2024-09-11T14:21:36.190 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.FlattenViaLockOwner 2024-09-11T14:21:36.190 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9949: Skipped 2024-09-11T14:21:36.190 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.190 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.FlattenViaLockOwner (0 ms) 2024-09-11T14:21:36.190 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ResizeViaLockOwner 2024-09-11T14:21:36.190 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:9997: Skipped 2024-09-11T14:21:36.190 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.190 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ResizeViaLockOwner (0 ms) 2024-09-11T14:21:36.190 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.SparsifyViaLockOwner 2024-09-11T14:21:36.190 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:10033: Skipped 2024-09-11T14:21:36.190 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.190 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SparsifyViaLockOwner (0 ms) 2024-09-11T14:21:36.190 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ObjectMapConsistentSnap 2024-09-11T14:21:36.191 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:10069: Skipped 2024-09-11T14:21:36.191 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.191 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ObjectMapConsistentSnap (0 ms) 2024-09-11T14:21:36.191 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.Metadata 2024-09-11T14:21:36.191 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:10121: Skipped 2024-09-11T14:21:36.191 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.191 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.Metadata (0 ms) 2024-09-11T14:21:36.191 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.MetadataPP 2024-09-11T14:21:36.191 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:10310: Skipped 2024-09-11T14:21:36.191 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.191 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.MetadataPP (0 ms) 2024-09-11T14:21:36.191 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.UpdateFeatures 2024-09-11T14:21:36.191 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:10391: Skipped 2024-09-11T14:21:36.192 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.192 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.UpdateFeatures (0 ms) 2024-09-11T14:21:36.192 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.FeaturesBitmaskString 2024-09-11T14:21:36.192 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.FeaturesBitmaskString (0 ms) 2024-09-11T14:21:36.192 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.RebuildObjectMap 2024-09-11T14:21:36.192 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:36.315 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.RebuildObjectMap (131 ms) 2024-09-11T14:21:36.315 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.RebuildNewObjectMap 2024-09-11T14:21:36.316 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:10584: Skipped 2024-09-11T14:21:36.316 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.316 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.RebuildNewObjectMap (0 ms) 2024-09-11T14:21:36.316 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.CheckObjectMap 2024-09-11T14:21:36.316 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:10609: Skipped 2024-09-11T14:21:36.316 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.316 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.CheckObjectMap (0 ms) 2024-09-11T14:21:36.316 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.BlockingAIO 2024-09-11T14:21:36.316 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:36.465 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.BlockingAIO (149 ms) 2024-09-11T14:21:36.465 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ExclusiveLockTransition 2024-09-11T14:21:36.465 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:10737: Skipped 2024-09-11T14:21:36.465 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.465 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockTransition (0 ms) 2024-09-11T14:21:36.465 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ExclusiveLockReadTransition 2024-09-11T14:21:36.465 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:10793: Skipped 2024-09-11T14:21:36.465 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.466 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition (0 ms) 2024-09-11T14:21:36.466 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.CacheMayCopyOnWrite 2024-09-11T14:21:36.466 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:10846: Skipped 2024-09-11T14:21:36.466 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:36.466 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.CacheMayCopyOnWrite (0 ms) 2024-09-11T14:21:36.466 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot 2024-09-11T14:21:36.466 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:37.256 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot (792 ms) 2024-09-11T14:21:37.256 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestImageOptions 2024-09-11T14:21:42.133 INFO:tasks.workunit.client.0.smithi150.stdout:0.00% done 2024-09-11T14:21:42.133 INFO:tasks.workunit.client.0.smithi150.stdout:100.00% done 2024-09-11T14:21:42.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestImageOptions (4876 ms) 2024-09-11T14:21:42.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestImageOptionsPP 2024-09-11T14:21:44.529 INFO:tasks.workunit.client.0.smithi150.stdout:0.00% done 2024-09-11T14:21:44.529 INFO:tasks.workunit.client.0.smithi150.stdout:100.00% done 2024-09-11T14:21:44.529 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestImageOptionsPP (2395 ms) 2024-09-11T14:21:44.529 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.EventSocketPipe 2024-09-11T14:21:44.529 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.EventSocketPipe (0 ms) 2024-09-11T14:21:44.529 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.EventSocketEventfd 2024-09-11T14:21:44.529 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.EventSocketEventfd (0 ms) 2024-09-11T14:21:44.529 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ImagePollIO 2024-09-11T14:21:44.529 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:44.894 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:21:44.895 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:21:44.895 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:21:44.895 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:21:44.895 INFO:tasks.workunit.client.0.smithi150.stdout:wrote: 512 2024-09-11T14:21:44.895 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:44.896 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:21:44.896 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:21:44.896 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:21:44.896 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:21:44.896 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:44.896 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:21:44.896 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:21:44.896 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:21:44.896 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:21:44.896 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:44.896 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:21:44.897 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:21:44.897 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:21:44.897 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:21:44.897 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:44.897 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:21:44.897 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:21:44.897 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:21:44.897 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:21:44.897 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:44.897 INFO:tasks.workunit.client.0.smithi150.stdout:started write 2024-09-11T14:21:44.898 INFO:tasks.workunit.client.0.smithi150.stdout:write completion cb called! 2024-09-11T14:21:44.898 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 0 2024-09-11T14:21:44.898 INFO:tasks.workunit.client.0.smithi150.stdout:finished write 2024-09-11T14:21:44.898 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:44.898 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:21:44.898 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:21:44.898 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:21:44.898 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:44.898 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:21:44.898 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:21:44.898 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:21:44.898 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:44.899 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:21:44.899 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:21:44.899 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:21:44.899 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:44.899 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:21:44.899 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:21:44.899 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:21:44.899 INFO:tasks.workunit.client.0.smithi150.stdout:created completion 2024-09-11T14:21:44.899 INFO:tasks.workunit.client.0.smithi150.stdout:started read 2024-09-11T14:21:44.899 INFO:tasks.workunit.client.0.smithi150.stdout:read completion cb called! 2024-09-11T14:21:44.899 INFO:tasks.workunit.client.0.smithi150.stdout:return value is: 512 2024-09-11T14:21:44.899 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.ImagePollIO (366 ms) 2024-09-11T14:21:44.899 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.Mirror 2024-09-11T14:21:44.957 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:45.009 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:45.447 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.Mirror (552 ms) 2024-09-11T14:21:45.447 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.MirrorPeerAttributes 2024-09-11T14:21:45.598 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.MirrorPeerAttributes (151 ms) 2024-09-11T14:21:45.598 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.CreateWithMirrorEnabled 2024-09-11T14:21:45.598 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:11322: Skipped 2024-09-11T14:21:45.598 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:45.598 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.CreateWithMirrorEnabled (0 ms) 2024-09-11T14:21:45.598 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-09-11T14:21:45.598 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:11364: Skipped 2024-09-11T14:21:45.598 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:45.598 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot (0 ms) 2024-09-11T14:21:45.599 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ExclusiveLock 2024-09-11T14:21:45.599 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:11410: Skipped 2024-09-11T14:21:45.599 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:45.599 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLock (0 ms) 2024-09-11T14:21:45.599 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.BreakLock 2024-09-11T14:21:45.599 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:11553: Skipped 2024-09-11T14:21:45.599 INFO:tasks.workunit.client.0.smithi150.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:21:45.599 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.BreakLock (0 ms) 2024-09-11T14:21:45.599 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.DiscardAfterWrite 2024-09-11T14:21:45.599 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:45.706 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.DiscardAfterWrite (107 ms) 2024-09-11T14:21:45.706 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.DefaultFeatures 2024-09-11T14:21:45.706 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.DefaultFeatures (0 ms) 2024-09-11T14:21:45.706 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurge 2024-09-11T14:21:45.706 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:11676: Skipped 2024-09-11T14:21:45.706 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:45.706 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurge (0 ms) 2024-09-11T14:21:45.706 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-09-11T14:21:45.706 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:11722: Skipped 2024-09-11T14:21:45.707 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:45.707 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay (0 ms) 2024-09-11T14:21:45.707 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestTrashPurge 2024-09-11T14:21:45.707 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:11753: Skipped 2024-09-11T14:21:45.707 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:45.707 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestTrashPurge (0 ms) 2024-09-11T14:21:45.707 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndRestore 2024-09-11T14:21:45.707 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:11810: Skipped 2024-09-11T14:21:45.707 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:45.707 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndRestore (1 ms) 2024-09-11T14:21:45.707 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestListWatchers 2024-09-11T14:21:45.707 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:45.951 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestListWatchers (245 ms) 2024-09-11T14:21:45.951 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestSetSnapById 2024-09-11T14:21:45.951 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:47.226 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.TestSetSnapById (1276 ms) 2024-09-11T14:21:47.226 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.Namespaces 2024-09-11T14:21:47.610 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.Namespaces (383 ms) 2024-09-11T14:21:47.610 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.NamespacesPP 2024-09-11T14:21:48.033 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:48.048 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.NamespacesPP (438 ms) 2024-09-11T14:21:48.048 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.Migration 2024-09-11T14:21:48.048 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:48.048 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:52.596 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.Migration (4549 ms) 2024-09-11T14:21:52.597 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.MigrationPP 2024-09-11T14:21:52.597 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:52.597 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:21:57.194 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.MigrationPP (4596 ms) 2024-09-11T14:21:57.194 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestGetAccessTimestamp 2024-09-11T14:21:57.194 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:12177: Skipped 2024-09-11T14:21:57.194 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:57.194 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestGetAccessTimestamp (0 ms) 2024-09-11T14:21:57.194 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.TestGetModifyTimestamp 2024-09-11T14:21:57.194 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:12202: Skipped 2024-09-11T14:21:57.194 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:57.194 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestGetModifyTimestamp (0 ms) 2024-09-11T14:21:57.195 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ZeroOverlapFlatten 2024-09-11T14:21:57.195 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:12225: Skipped 2024-09-11T14:21:57.195 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:57.195 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ZeroOverlapFlatten (0 ms) 2024-09-11T14:21:57.195 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.PoolMetadata 2024-09-11T14:21:57.195 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:12258: Skipped 2024-09-11T14:21:57.195 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:57.195 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.PoolMetadata (0 ms) 2024-09-11T14:21:57.195 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.PoolMetadataPP 2024-09-11T14:21:57.195 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:12370: Skipped 2024-09-11T14:21:57.195 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:57.195 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.PoolMetadataPP (0 ms) 2024-09-11T14:21:57.195 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.Config 2024-09-11T14:21:57.195 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:12422: Skipped 2024-09-11T14:21:57.196 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:57.196 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.Config (0 ms) 2024-09-11T14:21:57.196 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ConfigPP 2024-09-11T14:21:57.196 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:12506: Skipped 2024-09-11T14:21:57.196 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:57.196 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ConfigPP (0 ms) 2024-09-11T14:21:57.196 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.PoolStatsPP 2024-09-11T14:21:57.196 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:12583: Skipped 2024-09-11T14:21:57.196 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:57.196 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.PoolStatsPP (0 ms) 2024-09-11T14:21:57.196 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ImageSpec 2024-09-11T14:21:57.196 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:12658: Skipped 2024-09-11T14:21:57.196 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:57.197 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ImageSpec (0 ms) 2024-09-11T14:21:57.197 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.SnapRemoveWithChildMissing 2024-09-11T14:21:57.197 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:12853: Skipped 2024-09-11T14:21:57.197 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:21:57.197 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveWithChildMissing (0 ms) 2024-09-11T14:21:57.197 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.QuiesceWatch 2024-09-11T14:21:57.197 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:22:03.484 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.QuiesceWatch (6291 ms) 2024-09-11T14:22:03.485 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.QuiesceWatchPP 2024-09-11T14:22:03.485 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:22:09.478 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.QuiesceWatchPP (5994 ms) 2024-09-11T14:22:09.478 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.QuiesceWatchError 2024-09-11T14:22:09.478 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:13115: Skipped 2024-09-11T14:22:09.478 INFO:tasks.workunit.client.0.smithi150.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:09.479 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError (0 ms) 2024-09-11T14:22:09.479 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.QuiesceWatchTimeout 2024-09-11T14:22:09.479 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:22:09.577 INFO:tasks.workunit.client.0.smithi150.stderr:test quiesce is not long enough to time out 2024-09-11T14:22:18.307 INFO:tasks.workunit.client.0.smithi150.stderr:test quiesce is timed out 2024-09-11T14:22:18.342 INFO:tasks.workunit.client.0.smithi150.stderr:waiting for timed out ... 0 2024-09-11T14:22:19.343 INFO:tasks.workunit.client.0.smithi150.stderr:waiting for timed out ... 1 2024-09-11T14:22:20.343 INFO:tasks.workunit.client.0.smithi150.stderr:waiting for timed out ... 2 2024-09-11T14:22:21.345 INFO:tasks.workunit.client.0.smithi150.stderr:waiting for timed out ... 3 2024-09-11T14:22:22.343 INFO:tasks.workunit.client.0.smithi150.stderr:waiting for timed out ... 4 2024-09-11T14:22:23.343 INFO:tasks.workunit.client.0.smithi150.stderr:waiting for timed out ... 5 2024-09-11T14:22:24.343 INFO:tasks.workunit.client.0.smithi150.stderr:waiting for timed out ... 6 2024-09-11T14:22:25.344 INFO:tasks.workunit.client.0.smithi150.stderr:waiting for timed out ... 7 2024-09-11T14:22:26.344 INFO:tasks.workunit.client.0.smithi150.stderr:waiting for timed out ... 8 2024-09-11T14:22:27.344 INFO:tasks.workunit.client.0.smithi150.stderr:waiting for timed out ... 9 2024-09-11T14:22:28.344 INFO:tasks.workunit.client.0.smithi150.stderr:waiting for timed out ... 10 2024-09-11T14:22:39.344 INFO:tasks.workunit.client.0.smithi150.stderr:test retry succeeds 2024-09-11T14:22:42.541 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.QuiesceWatchTimeout (33063 ms) 2024-09-11T14:22:42.541 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.WriteZeroes 2024-09-11T14:22:42.541 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:22:42.804 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.WriteZeroes (263 ms) 2024-09-11T14:22:42.804 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.WriteZeroesThickProvision 2024-09-11T14:22:42.804 INFO:tasks.workunit.client.0.smithi150.stdout:using old format 2024-09-11T14:22:43.148 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestLibRBD.WriteZeroesThickProvision (344 ms) 2024-09-11T14:22:43.148 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.ConcurrentOperations 2024-09-11T14:22:43.148 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:13474: Skipped 2024-09-11T14:22:43.148 INFO:tasks.workunit.client.0.smithi150.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:43.148 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations (0 ms) 2024-09-11T14:22:43.148 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestLibRBD.FormatAndCloneFormatOptions 2024-09-11T14:22:43.148 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:13630: Skipped 2024-09-11T14:22:43.148 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:43.148 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.FormatAndCloneFormatOptions (0 ms) 2024-09-11T14:22:50.137 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 171 tests from TestLibRBD (590516 ms total) 2024-09-11T14:22:50.137 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:22:50.137 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:22:50.137 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 171 tests from 1 test suite ran. (597552 ms total) 2024-09-11T14:22:50.137 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 104 tests. 2024-09-11T14:22:50.137 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 67 tests, listed below: 2024-09-11T14:22:50.137 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.CreateWithSameDataPool 2024-09-11T14:22:50.137 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestGetCreateTimestamp 2024-09-11T14:22:50.137 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.GetCreateTimestampPP 2024-09-11T14:22:50.137 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopy 2024-09-11T14:22:50.138 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopyPP 2024-09-11T14:22:50.138 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestGetSnapShotTimeStamp 2024-09-11T14:22:50.138 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryDataPool 2024-09-11T14:22:50.138 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespace 2024-09-11T14:22:50.138 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespaceDataPool 2024-09-11T14:22:50.138 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestCloneEncryption 2024-09-11T14:22:50.138 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.LUKS1UnderLUKS2WithoutResize 2024-09-11T14:22:50.138 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.LUKS2UnderLUKS1WithoutResize 2024-09-11T14:22:50.138 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-11T14:22:50.138 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadFormatMismatch 2024-09-11T14:22:50.138 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.EncryptedFlattenSmallData 2024-09-11T14:22:50.138 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestDataPoolIO 2024-09-11T14:22:50.138 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestClone 2024-09-11T14:22:50.138 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestClone2 2024-09-11T14:22:50.139 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ListChildren 2024-09-11T14:22:50.139 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered 2024-09-11T14:22:50.139 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestPendingAio 2024-09-11T14:22:50.139 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyup 2024-09-11T14:22:50.139 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-09-11T14:22:50.139 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.Flatten 2024-09-11T14:22:50.139 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-09-11T14:22:50.139 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.RenameViaLockOwner 2024-09-11T14:22:50.139 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SnapCreateViaLockOwner 2024-09-11T14:22:50.139 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveViaLockOwner 2024-09-11T14:22:50.139 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-09-11T14:22:50.139 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-11T14:22:50.139 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SnapRemove2 2024-09-11T14:22:50.139 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SnapRenameViaLockOwner 2024-09-11T14:22:50.140 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SnapProtectViaLockOwner 2024-09-11T14:22:50.140 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SnapUnprotectViaLockOwner 2024-09-11T14:22:50.140 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.FlattenViaLockOwner 2024-09-11T14:22:50.140 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ResizeViaLockOwner 2024-09-11T14:22:50.140 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SparsifyViaLockOwner 2024-09-11T14:22:50.140 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ObjectMapConsistentSnap 2024-09-11T14:22:50.140 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.Metadata 2024-09-11T14:22:50.140 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.MetadataPP 2024-09-11T14:22:50.140 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.UpdateFeatures 2024-09-11T14:22:50.140 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.RebuildNewObjectMap 2024-09-11T14:22:50.140 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.CheckObjectMap 2024-09-11T14:22:50.140 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockTransition 2024-09-11T14:22:50.141 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition 2024-09-11T14:22:50.141 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.CacheMayCopyOnWrite 2024-09-11T14:22:50.141 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.CreateWithMirrorEnabled 2024-09-11T14:22:50.141 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-09-11T14:22:50.141 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLock 2024-09-11T14:22:50.141 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.BreakLock 2024-09-11T14:22:50.141 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurge 2024-09-11T14:22:50.141 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-09-11T14:22:50.141 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestTrashPurge 2024-09-11T14:22:50.141 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndRestore 2024-09-11T14:22:50.141 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestGetAccessTimestamp 2024-09-11T14:22:50.141 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.TestGetModifyTimestamp 2024-09-11T14:22:50.141 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ZeroOverlapFlatten 2024-09-11T14:22:50.141 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.PoolMetadata 2024-09-11T14:22:50.142 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.PoolMetadataPP 2024-09-11T14:22:50.142 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.Config 2024-09-11T14:22:50.142 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ConfigPP 2024-09-11T14:22:50.142 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.PoolStatsPP 2024-09-11T14:22:50.142 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ImageSpec 2024-09-11T14:22:50.142 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveWithChildMissing 2024-09-11T14:22:50.142 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError 2024-09-11T14:22:50.142 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations 2024-09-11T14:22:50.142 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestLibRBD.FormatAndCloneFormatOptions 2024-09-11T14:22:50.142 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:22:50.142 INFO:tasks.workunit.client.0.smithi150.stdout: YOU HAVE 1 DISABLED TEST 2024-09-11T14:22:50.142 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:22:50.204 INFO:tasks.workunit.client.0.smithi150.stdout:seed 31441 2024-09-11T14:22:50.205 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = EncryptedFlattenTest/0.* 2024-09-11T14:22:50.205 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-11T14:22:50.205 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:22:50.205 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/0, where TypeParam = PlaintextUnderLUKS1 2024-09-11T14:22:50.304 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/0.Simple 2024-09-11T14:22:52.151 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-11T14:22:52.151 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:52.151 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Simple (1846 ms) 2024-09-11T14:22:52.151 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/0.Grow 2024-09-11T14:22:52.151 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-11T14:22:52.151 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:52.151 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Grow (0 ms) 2024-09-11T14:22:52.151 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/0.Shrink 2024-09-11T14:22:52.151 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-11T14:22:52.151 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:52.151 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Shrink (0 ms) 2024-09-11T14:22:52.152 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOne 2024-09-11T14:22:52.152 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-11T14:22:52.152 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:52.152 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOne (0 ms) 2024-09-11T14:22:52.152 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot 2024-09-11T14:22:52.152 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-11T14:22:52.152 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:52.152 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot (0 ms) 2024-09-11T14:22:52.152 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/0.MinOverlap 2024-09-11T14:22:52.152 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-11T14:22:52.152 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:52.152 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/0.MinOverlap (0 ms) 2024-09-11T14:22:52.152 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/0.ZeroOverlap 2024-09-11T14:22:52.153 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-11T14:22:52.153 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:52.153 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ZeroOverlap (0 ms) 2024-09-11T14:22:53.159 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/0 (1846 ms total) 2024-09-11T14:22:53.159 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:22:53.159 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:22:53.159 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 7 tests from 1 test suite ran. (2954 ms total) 2024-09-11T14:22:53.159 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 0 tests. 2024-09-11T14:22:53.160 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-11T14:22:53.160 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Simple 2024-09-11T14:22:53.160 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Grow 2024-09-11T14:22:53.160 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Shrink 2024-09-11T14:22:53.160 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOne 2024-09-11T14:22:53.160 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot 2024-09-11T14:22:53.160 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/0.MinOverlap 2024-09-11T14:22:53.160 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ZeroOverlap 2024-09-11T14:22:53.234 INFO:tasks.workunit.client.0.smithi150.stdout:seed 31505 2024-09-11T14:22:53.234 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = EncryptedFlattenTest/1.* 2024-09-11T14:22:53.235 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-11T14:22:53.235 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:22:53.235 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/1, where TypeParam = PlaintextUnderLUKS2 2024-09-11T14:22:53.298 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/1.Simple 2024-09-11T14:22:55.165 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-11T14:22:55.165 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:55.165 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Simple (1866 ms) 2024-09-11T14:22:55.165 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/1.Grow 2024-09-11T14:22:55.166 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-11T14:22:55.166 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:55.166 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Grow (0 ms) 2024-09-11T14:22:55.166 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/1.Shrink 2024-09-11T14:22:55.166 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-11T14:22:55.166 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:55.166 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Shrink (0 ms) 2024-09-11T14:22:55.166 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOne 2024-09-11T14:22:55.166 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-11T14:22:55.166 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:55.166 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOne (0 ms) 2024-09-11T14:22:55.166 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot 2024-09-11T14:22:55.166 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-11T14:22:55.167 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:55.167 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot (0 ms) 2024-09-11T14:22:55.167 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/1.MinOverlap 2024-09-11T14:22:55.167 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-11T14:22:55.167 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:55.167 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/1.MinOverlap (0 ms) 2024-09-11T14:22:55.167 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/1.ZeroOverlap 2024-09-11T14:22:55.167 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-11T14:22:55.167 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:55.167 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ZeroOverlap (0 ms) 2024-09-11T14:22:56.165 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/1 (1866 ms total) 2024-09-11T14:22:56.165 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:22:56.165 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:22:56.166 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 7 tests from 1 test suite ran. (2930 ms total) 2024-09-11T14:22:56.166 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 0 tests. 2024-09-11T14:22:56.166 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-11T14:22:56.166 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Simple 2024-09-11T14:22:56.166 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Grow 2024-09-11T14:22:56.166 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Shrink 2024-09-11T14:22:56.166 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOne 2024-09-11T14:22:56.166 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot 2024-09-11T14:22:56.166 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/1.MinOverlap 2024-09-11T14:22:56.166 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ZeroOverlap 2024-09-11T14:22:56.240 INFO:tasks.workunit.client.0.smithi150.stdout:seed 31569 2024-09-11T14:22:56.241 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = EncryptedFlattenTest/2.* 2024-09-11T14:22:56.241 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-11T14:22:56.241 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:22:56.241 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/2, where TypeParam = UnformattedLUKS1 2024-09-11T14:22:56.319 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/2.Simple 2024-09-11T14:22:58.181 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-11T14:22:58.181 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:58.181 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Simple (1861 ms) 2024-09-11T14:22:58.181 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/2.Grow 2024-09-11T14:22:58.181 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-11T14:22:58.181 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:58.181 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Grow (0 ms) 2024-09-11T14:22:58.181 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/2.Shrink 2024-09-11T14:22:58.181 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-11T14:22:58.181 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:58.181 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Shrink (0 ms) 2024-09-11T14:22:58.182 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOne 2024-09-11T14:22:58.182 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-11T14:22:58.182 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:58.182 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOne (0 ms) 2024-09-11T14:22:58.182 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot 2024-09-11T14:22:58.182 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-11T14:22:58.182 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:58.182 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot (0 ms) 2024-09-11T14:22:58.182 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/2.MinOverlap 2024-09-11T14:22:58.182 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-11T14:22:58.182 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:58.182 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/2.MinOverlap (0 ms) 2024-09-11T14:22:58.183 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/2.ZeroOverlap 2024-09-11T14:22:58.183 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-11T14:22:58.183 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:22:58.183 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ZeroOverlap (0 ms) 2024-09-11T14:22:59.183 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/2 (1861 ms total) 2024-09-11T14:22:59.183 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:22:59.184 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:22:59.184 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 7 tests from 1 test suite ran. (2943 ms total) 2024-09-11T14:22:59.184 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 0 tests. 2024-09-11T14:22:59.184 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-11T14:22:59.184 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Simple 2024-09-11T14:22:59.184 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Grow 2024-09-11T14:22:59.184 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Shrink 2024-09-11T14:22:59.184 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOne 2024-09-11T14:22:59.184 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot 2024-09-11T14:22:59.184 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/2.MinOverlap 2024-09-11T14:22:59.184 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ZeroOverlap 2024-09-11T14:22:59.276 INFO:tasks.workunit.client.0.smithi150.stdout:seed 31633 2024-09-11T14:22:59.276 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = EncryptedFlattenTest/3.* 2024-09-11T14:22:59.276 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-11T14:22:59.276 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:22:59.276 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/3, where TypeParam = LUKS1UnderLUKS1 2024-09-11T14:22:59.366 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/3.Simple 2024-09-11T14:23:01.201 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-11T14:23:01.201 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:01.201 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Simple (1834 ms) 2024-09-11T14:23:01.201 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/3.Grow 2024-09-11T14:23:01.201 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-11T14:23:01.201 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:01.201 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Grow (0 ms) 2024-09-11T14:23:01.201 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/3.Shrink 2024-09-11T14:23:01.201 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-11T14:23:01.201 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Shrink (0 ms) 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOne 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOne (0 ms) 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot (0 ms) 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/3.MinOverlap 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/3.MinOverlap (0 ms) 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/3.ZeroOverlap 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-11T14:23:01.202 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:01.203 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ZeroOverlap (0 ms) 2024-09-11T14:23:02.200 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/3 (1834 ms total) 2024-09-11T14:23:02.200 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:23:02.200 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:23:02.200 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 7 tests from 1 test suite ran. (2924 ms total) 2024-09-11T14:23:02.200 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 0 tests. 2024-09-11T14:23:02.200 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-11T14:23:02.200 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Simple 2024-09-11T14:23:02.200 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Grow 2024-09-11T14:23:02.200 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Shrink 2024-09-11T14:23:02.200 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOne 2024-09-11T14:23:02.200 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot 2024-09-11T14:23:02.201 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/3.MinOverlap 2024-09-11T14:23:02.201 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ZeroOverlap 2024-09-11T14:23:02.261 INFO:tasks.workunit.client.0.smithi150.stdout:seed 31697 2024-09-11T14:23:02.261 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = EncryptedFlattenTest/4.* 2024-09-11T14:23:02.262 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-11T14:23:02.262 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:23:02.262 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/4, where TypeParam = LUKS1UnderLUKS2 2024-09-11T14:23:02.378 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/4.Simple 2024-09-11T14:23:04.209 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-11T14:23:04.209 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:04.209 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Simple (1830 ms) 2024-09-11T14:23:04.209 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/4.Grow 2024-09-11T14:23:04.209 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-11T14:23:04.209 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:04.209 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Grow (0 ms) 2024-09-11T14:23:04.210 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/4.Shrink 2024-09-11T14:23:04.210 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-11T14:23:04.210 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:04.210 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Shrink (0 ms) 2024-09-11T14:23:04.210 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOne 2024-09-11T14:23:04.210 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-11T14:23:04.210 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:04.210 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOne (0 ms) 2024-09-11T14:23:04.210 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot 2024-09-11T14:23:04.210 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-11T14:23:04.210 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:04.210 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot (0 ms) 2024-09-11T14:23:04.210 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/4.MinOverlap 2024-09-11T14:23:04.211 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-11T14:23:04.211 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:04.211 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/4.MinOverlap (0 ms) 2024-09-11T14:23:04.211 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/4.ZeroOverlap 2024-09-11T14:23:04.211 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-11T14:23:04.211 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:04.211 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ZeroOverlap (0 ms) 2024-09-11T14:23:05.212 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/4 (1830 ms total) 2024-09-11T14:23:05.212 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:23:05.212 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:23:05.212 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 7 tests from 1 test suite ran. (2950 ms total) 2024-09-11T14:23:05.212 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 0 tests. 2024-09-11T14:23:05.212 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-11T14:23:05.212 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Simple 2024-09-11T14:23:05.212 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Grow 2024-09-11T14:23:05.213 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Shrink 2024-09-11T14:23:05.213 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOne 2024-09-11T14:23:05.213 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot 2024-09-11T14:23:05.213 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/4.MinOverlap 2024-09-11T14:23:05.213 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ZeroOverlap 2024-09-11T14:23:05.274 INFO:tasks.workunit.client.0.smithi150.stdout:seed 31761 2024-09-11T14:23:05.274 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = EncryptedFlattenTest/5.* 2024-09-11T14:23:05.274 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-11T14:23:05.274 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:23:05.274 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/5, where TypeParam = UnformattedLUKS2 2024-09-11T14:23:05.369 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/5.Simple 2024-09-11T14:23:07.220 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-11T14:23:07.220 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:07.220 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Simple (1850 ms) 2024-09-11T14:23:07.221 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/5.Grow 2024-09-11T14:23:07.221 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-11T14:23:07.221 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:07.221 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Grow (0 ms) 2024-09-11T14:23:07.221 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/5.Shrink 2024-09-11T14:23:07.221 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-11T14:23:07.221 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:07.221 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Shrink (0 ms) 2024-09-11T14:23:07.221 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOne 2024-09-11T14:23:07.221 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-11T14:23:07.221 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:07.221 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOne (0 ms) 2024-09-11T14:23:07.221 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot 2024-09-11T14:23:07.222 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-11T14:23:07.222 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:07.222 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot (1 ms) 2024-09-11T14:23:07.222 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/5.MinOverlap 2024-09-11T14:23:07.222 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-11T14:23:07.222 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:07.222 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/5.MinOverlap (0 ms) 2024-09-11T14:23:07.222 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/5.ZeroOverlap 2024-09-11T14:23:07.222 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-11T14:23:07.222 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:07.222 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ZeroOverlap (0 ms) 2024-09-11T14:23:08.219 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/5 (1851 ms total) 2024-09-11T14:23:08.219 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:23:08.220 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:23:08.220 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 7 tests from 1 test suite ran. (2945 ms total) 2024-09-11T14:23:08.220 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 0 tests. 2024-09-11T14:23:08.220 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-11T14:23:08.220 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Simple 2024-09-11T14:23:08.220 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Grow 2024-09-11T14:23:08.220 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Shrink 2024-09-11T14:23:08.220 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOne 2024-09-11T14:23:08.220 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot 2024-09-11T14:23:08.220 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/5.MinOverlap 2024-09-11T14:23:08.220 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ZeroOverlap 2024-09-11T14:23:08.311 INFO:tasks.workunit.client.0.smithi150.stdout:seed 31825 2024-09-11T14:23:08.312 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = EncryptedFlattenTest/6.* 2024-09-11T14:23:08.312 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-11T14:23:08.312 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:23:08.312 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/6, where TypeParam = LUKS2UnderLUKS2 2024-09-11T14:23:08.394 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/6.Simple 2024-09-11T14:23:09.993 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-11T14:23:09.993 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:09.993 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Simple (1598 ms) 2024-09-11T14:23:09.993 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/6.Grow 2024-09-11T14:23:09.993 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-11T14:23:09.993 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:09.993 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Grow (0 ms) 2024-09-11T14:23:09.993 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/6.Shrink 2024-09-11T14:23:09.993 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-11T14:23:09.994 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:09.994 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Shrink (0 ms) 2024-09-11T14:23:09.994 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOne 2024-09-11T14:23:09.994 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-11T14:23:09.994 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:09.994 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOne (0 ms) 2024-09-11T14:23:09.994 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot 2024-09-11T14:23:09.994 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-11T14:23:09.994 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:09.994 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot (0 ms) 2024-09-11T14:23:09.994 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/6.MinOverlap 2024-09-11T14:23:09.994 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-11T14:23:09.994 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:09.994 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/6.MinOverlap (0 ms) 2024-09-11T14:23:09.995 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/6.ZeroOverlap 2024-09-11T14:23:09.995 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-11T14:23:09.995 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:09.995 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ZeroOverlap (0 ms) 2024-09-11T14:23:10.991 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/6 (1598 ms total) 2024-09-11T14:23:10.992 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:23:10.992 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:23:10.992 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 7 tests from 1 test suite ran. (2680 ms total) 2024-09-11T14:23:10.992 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 0 tests. 2024-09-11T14:23:10.992 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-11T14:23:10.992 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Simple 2024-09-11T14:23:10.992 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Grow 2024-09-11T14:23:10.992 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Shrink 2024-09-11T14:23:10.992 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOne 2024-09-11T14:23:10.992 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot 2024-09-11T14:23:10.992 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/6.MinOverlap 2024-09-11T14:23:10.992 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ZeroOverlap 2024-09-11T14:23:11.065 INFO:tasks.workunit.client.0.smithi150.stdout:seed 31889 2024-09-11T14:23:11.078 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = EncryptedFlattenTest/7.* 2024-09-11T14:23:11.078 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-11T14:23:11.078 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:23:11.078 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/7, where TypeParam = LUKS2UnderLUKS1 2024-09-11T14:23:11.167 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/7.Simple 2024-09-11T14:23:13.000 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-11T14:23:13.000 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:13.000 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Simple (1832 ms) 2024-09-11T14:23:13.000 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/7.Grow 2024-09-11T14:23:13.000 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-11T14:23:13.000 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:13.000 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Grow (0 ms) 2024-09-11T14:23:13.000 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/7.Shrink 2024-09-11T14:23:13.000 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-11T14:23:13.000 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:13.000 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Shrink (0 ms) 2024-09-11T14:23:13.001 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOne 2024-09-11T14:23:13.001 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-11T14:23:13.001 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:13.001 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOne (0 ms) 2024-09-11T14:23:13.001 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot 2024-09-11T14:23:13.001 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-11T14:23:13.001 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:13.001 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot (0 ms) 2024-09-11T14:23:13.001 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/7.MinOverlap 2024-09-11T14:23:13.001 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-11T14:23:13.001 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:13.001 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/7.MinOverlap (0 ms) 2024-09-11T14:23:13.001 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] EncryptedFlattenTest/7.ZeroOverlap 2024-09-11T14:23:13.001 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-11T14:23:13.002 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:13.002 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ZeroOverlap (0 ms) 2024-09-11T14:23:13.993 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 7 tests from EncryptedFlattenTest/7 (1832 ms total) 2024-09-11T14:23:13.993 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:23:13.993 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:23:13.993 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 7 tests from 1 test suite ran. (2915 ms total) 2024-09-11T14:23:13.993 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 0 tests. 2024-09-11T14:23:13.993 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-11T14:23:13.993 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Simple 2024-09-11T14:23:13.993 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Grow 2024-09-11T14:23:13.994 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Shrink 2024-09-11T14:23:13.994 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOne 2024-09-11T14:23:13.994 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot 2024-09-11T14:23:13.994 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/7.MinOverlap 2024-09-11T14:23:13.994 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ZeroOverlap 2024-09-11T14:23:14.067 INFO:tasks.workunit.client.0.smithi150.stdout:seed 31953 2024-09-11T14:23:14.067 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = TestImageWatcher.* 2024-09-11T14:23:14.068 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-11T14:23:14.068 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:23:14.068 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 17 tests from TestImageWatcher 2024-09-11T14:23:16.013 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifyHeaderUpdate 2024-09-11T14:23:18.175 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:460: Skipped 2024-09-11T14:23:18.175 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.175 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyHeaderUpdate (2162 ms) 2024-09-11T14:23:18.176 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifyFlatten 2024-09-11T14:23:18.222 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:478: Skipped 2024-09-11T14:23:18.222 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.222 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyFlatten (48 ms) 2024-09-11T14:23:18.223 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifyResize 2024-09-11T14:23:18.271 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:512: Skipped 2024-09-11T14:23:18.271 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.271 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyResize (48 ms) 2024-09-11T14:23:18.271 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifyRebuildObjectMap 2024-09-11T14:23:18.318 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:546: Skipped 2024-09-11T14:23:18.318 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.318 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyRebuildObjectMap (47 ms) 2024-09-11T14:23:18.318 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifyUpdateFeatures 2024-09-11T14:23:18.370 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:581: Skipped 2024-09-11T14:23:18.370 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.370 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyUpdateFeatures (52 ms) 2024-09-11T14:23:18.370 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifySnapCreate 2024-09-11T14:23:18.426 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:611: Skipped 2024-09-11T14:23:18.427 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.427 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreate (57 ms) 2024-09-11T14:23:18.427 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifySnapCreateError 2024-09-11T14:23:18.479 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:646: Skipped 2024-09-11T14:23:18.479 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.479 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreateError (52 ms) 2024-09-11T14:23:18.479 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifySnapRename 2024-09-11T14:23:18.528 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:670: Skipped 2024-09-11T14:23:18.528 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.528 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRename (49 ms) 2024-09-11T14:23:18.528 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifySnapRenameError 2024-09-11T14:23:18.576 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:701: Skipped 2024-09-11T14:23:18.576 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.576 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRenameError (48 ms) 2024-09-11T14:23:18.576 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifySnapRemove 2024-09-11T14:23:18.622 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:723: Skipped 2024-09-11T14:23:18.622 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.622 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRemove (46 ms) 2024-09-11T14:23:18.622 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifySnapProtect 2024-09-11T14:23:18.670 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:754: Skipped 2024-09-11T14:23:18.670 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.670 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapProtect (48 ms) 2024-09-11T14:23:18.671 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifySnapUnprotect 2024-09-11T14:23:18.718 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:785: Skipped 2024-09-11T14:23:18.718 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.719 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapUnprotect (48 ms) 2024-09-11T14:23:18.719 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifyRename 2024-09-11T14:23:18.767 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:816: Skipped 2024-09-11T14:23:18.767 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.767 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyRename (49 ms) 2024-09-11T14:23:18.767 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifyAsyncTimedOut 2024-09-11T14:23:18.818 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:847: Skipped 2024-09-11T14:23:18.818 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.818 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncTimedOut (51 ms) 2024-09-11T14:23:18.818 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifyAsyncError 2024-09-11T14:23:18.866 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:867: Skipped 2024-09-11T14:23:18.866 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.866 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncError (48 ms) 2024-09-11T14:23:18.866 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifyAsyncCompleteError 2024-09-11T14:23:18.913 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:887: Skipped 2024-09-11T14:23:18.913 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.913 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncCompleteError (47 ms) 2024-09-11T14:23:18.914 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-09-11T14:23:18.974 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ImageWatcher.cc:918: Skipped 2024-09-11T14:23:18.974 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:18.975 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncRequestTimedOut (60 ms) 2024-09-11T14:23:19.082 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 17 tests from TestImageWatcher (2961 ms total) 2024-09-11T14:23:19.082 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:23:19.082 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:23:19.082 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 17 tests from 1 test suite ran. (5014 ms total) 2024-09-11T14:23:19.082 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 0 tests. 2024-09-11T14:23:19.082 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 17 tests, listed below: 2024-09-11T14:23:19.082 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyHeaderUpdate 2024-09-11T14:23:19.082 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyFlatten 2024-09-11T14:23:19.082 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyResize 2024-09-11T14:23:19.082 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyRebuildObjectMap 2024-09-11T14:23:19.082 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyUpdateFeatures 2024-09-11T14:23:19.082 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreate 2024-09-11T14:23:19.083 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreateError 2024-09-11T14:23:19.083 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRename 2024-09-11T14:23:19.083 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRenameError 2024-09-11T14:23:19.083 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRemove 2024-09-11T14:23:19.083 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapProtect 2024-09-11T14:23:19.083 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapUnprotect 2024-09-11T14:23:19.083 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyRename 2024-09-11T14:23:19.083 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncTimedOut 2024-09-11T14:23:19.083 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncError 2024-09-11T14:23:19.083 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncCompleteError 2024-09-11T14:23:19.083 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-09-11T14:23:19.165 INFO:tasks.workunit.client.0.smithi150.stdout:seed 32002 2024-09-11T14:23:19.166 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = TestInternal.* 2024-09-11T14:23:19.166 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 34 tests from 1 test suite. 2024-09-11T14:23:19.166 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:23:19.166 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 34 tests from TestInternal 2024-09-11T14:23:21.082 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.OpenByID 2024-09-11T14:23:23.195 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:176: Skipped 2024-09-11T14:23:23.195 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:23.195 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.OpenByID (2112 ms) 2024-09-11T14:23:23.195 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.OpenSnapDNE 2024-09-11T14:23:23.327 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestInternal.OpenSnapDNE (132 ms) 2024-09-11T14:23:23.327 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.IsExclusiveLockOwner 2024-09-11T14:23:23.385 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:198: Skipped 2024-09-11T14:23:23.385 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:23.385 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.IsExclusiveLockOwner (58 ms) 2024-09-11T14:23:23.385 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.ResizeLocksImage 2024-09-11T14:23:23.443 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:218: Skipped 2024-09-11T14:23:23.443 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:23.443 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.ResizeLocksImage (58 ms) 2024-09-11T14:23:23.443 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.ResizeFailsToLockImage 2024-09-11T14:23:23.492 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:232: Skipped 2024-09-11T14:23:23.492 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:23.492 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.ResizeFailsToLockImage (49 ms) 2024-09-11T14:23:23.492 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.SnapCreateLocksImage 2024-09-11T14:23:23.541 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:243: Skipped 2024-09-11T14:23:23.541 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:23.541 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapCreateLocksImage (50 ms) 2024-09-11T14:23:23.542 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.SnapCreateFailsToLockImage 2024-09-11T14:23:23.588 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:261: Skipped 2024-09-11T14:23:23.589 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:23.589 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapCreateFailsToLockImage (47 ms) 2024-09-11T14:23:23.589 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.SnapRollbackLocksImage 2024-09-11T14:23:23.637 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:271: Skipped 2024-09-11T14:23:23.637 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:23.637 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapRollbackLocksImage (49 ms) 2024-09-11T14:23:23.637 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.SnapRollbackFailsToLockImage 2024-09-11T14:23:23.691 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:289: Skipped 2024-09-11T14:23:23.691 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:23.691 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapRollbackFailsToLockImage (53 ms) 2024-09-11T14:23:23.691 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.SnapSetReleasesLock 2024-09-11T14:23:23.740 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:306: Skipped 2024-09-11T14:23:23.740 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:23.740 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapSetReleasesLock (50 ms) 2024-09-11T14:23:23.740 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.FlattenLocksImage 2024-09-11T14:23:23.789 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:321: Skipped 2024-09-11T14:23:23.789 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:23.789 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.FlattenLocksImage (48 ms) 2024-09-11T14:23:23.789 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.FlattenFailsToLockImage 2024-09-11T14:23:23.836 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:348: Skipped 2024-09-11T14:23:23.836 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:23.837 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.FlattenFailsToLockImage (48 ms) 2024-09-11T14:23:23.837 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-11T14:23:23.890 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:382: Skipped 2024-09-11T14:23:23.890 INFO:tasks.workunit.client.0.smithi150.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:23:23.890 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted (53 ms) 2024-09-11T14:23:23.890 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-11T14:23:23.939 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:416: Skipped 2024-09-11T14:23:23.939 INFO:tasks.workunit.client.0.smithi150.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:23:23.939 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch (49 ms) 2024-09-11T14:23:23.939 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.AioWriteRequestsLock 2024-09-11T14:23:23.988 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:455: Skipped 2024-09-11T14:23:23.988 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:23.988 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.AioWriteRequestsLock (49 ms) 2024-09-11T14:23:23.988 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.AioDiscardRequestsLock 2024-09-11T14:23:24.064 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:481: Skipped 2024-09-11T14:23:24.064 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:24.065 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.AioDiscardRequestsLock (77 ms) 2024-09-11T14:23:24.065 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.CancelAsyncResize 2024-09-11T14:23:24.117 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:503: Skipped 2024-09-11T14:23:24.117 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:24.117 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.CancelAsyncResize (53 ms) 2024-09-11T14:23:24.117 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.MultipleResize 2024-09-11T14:23:24.673 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestInternal.MultipleResize (555 ms) 2024-09-11T14:23:24.673 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.Metadata 2024-09-11T14:23:24.722 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:592: Skipped 2024-09-11T14:23:24.722 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:24.722 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.Metadata (50 ms) 2024-09-11T14:23:24.723 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.MetadataConfApply 2024-09-11T14:23:24.776 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:639: Skipped 2024-09-11T14:23:24.777 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:24.777 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.MetadataConfApply (54 ms) 2024-09-11T14:23:24.777 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.SnapshotCopyup 2024-09-11T14:23:24.834 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:662: Skipped 2024-09-11T14:23:24.834 INFO:tasks.workunit.client.0.smithi150.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:23:24.834 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup (57 ms) 2024-09-11T14:23:24.835 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.SnapshotCopyupZeros 2024-09-11T14:23:24.885 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:814: Skipped 2024-09-11T14:23:24.885 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:24.885 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZeros (51 ms) 2024-09-11T14:23:24.885 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.SnapshotCopyupZerosMigration 2024-09-11T14:23:24.934 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:902: Skipped 2024-09-11T14:23:24.934 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:24.934 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZerosMigration (49 ms) 2024-09-11T14:23:24.934 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.ResizeCopyup 2024-09-11T14:23:24.982 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:987: Skipped 2024-09-11T14:23:24.982 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:24.982 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.ResizeCopyup (47 ms) 2024-09-11T14:23:24.982 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.DiscardCopyup 2024-09-11T14:23:25.030 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:1052: Skipped 2024-09-11T14:23:25.030 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:25.030 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.DiscardCopyup (48 ms) 2024-09-11T14:23:25.030 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.ImageOptions 2024-09-11T14:23:25.081 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestInternal.ImageOptions (52 ms) 2024-09-11T14:23:25.082 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.WriteFullCopyup 2024-09-11T14:23:25.133 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:1183: Skipped 2024-09-11T14:23:25.133 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:25.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.WriteFullCopyup (51 ms) 2024-09-11T14:23:25.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.DiffIterateCloneOverwrite 2024-09-11T14:23:25.179 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:1257: Skipped 2024-09-11T14:23:25.179 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:25.179 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.DiffIterateCloneOverwrite (46 ms) 2024-09-11T14:23:25.179 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.TestCoR 2024-09-11T14:23:25.230 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:1307: Skipped 2024-09-11T14:23:25.230 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:25.230 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.TestCoR (51 ms) 2024-09-11T14:23:25.230 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.FlattenNoEmptyObjects 2024-09-11T14:23:25.278 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:1455: Skipped 2024-09-11T14:23:25.278 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:25.278 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.FlattenNoEmptyObjects (48 ms) 2024-09-11T14:23:25.278 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.PoolMetadataConfApply 2024-09-11T14:23:25.328 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:1574: Skipped 2024-09-11T14:23:25.328 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:25.329 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.PoolMetadataConfApply (51 ms) 2024-09-11T14:23:25.329 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.Sparsify 2024-09-11T14:23:25.556 INFO:tasks.workunit.client.0.smithi150.stdout:sparsify_supported=1 2024-09-11T14:23:25.557 INFO:tasks.workunit.client.0.smithi150.stdout:sparse_read_supported=1 2024-09-11T14:23:25.943 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestInternal.Sparsify (614 ms) 2024-09-11T14:23:25.943 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.SparsifyClone 2024-09-11T14:23:25.990 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:1737: Skipped 2024-09-11T14:23:25.991 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:25.991 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SparsifyClone (48 ms) 2024-09-11T14:23:25.991 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestInternal.MissingDataPool 2024-09-11T14:23:26.041 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_internal.cc:1800: Skipped 2024-09-11T14:23:26.042 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:26.042 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.MissingDataPool (49 ms) 2024-09-11T14:23:26.100 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 34 tests from TestInternal (4957 ms total) 2024-09-11T14:23:26.101 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:23:26.101 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:23:26.101 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 34 tests from 1 test suite ran. (6935 ms total) 2024-09-11T14:23:26.101 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 4 tests. 2024-09-11T14:23:26.101 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 30 tests, listed below: 2024-09-11T14:23:26.101 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.OpenByID 2024-09-11T14:23:26.101 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.IsExclusiveLockOwner 2024-09-11T14:23:26.101 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.ResizeLocksImage 2024-09-11T14:23:26.101 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.ResizeFailsToLockImage 2024-09-11T14:23:26.101 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapCreateLocksImage 2024-09-11T14:23:26.101 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapCreateFailsToLockImage 2024-09-11T14:23:26.101 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapRollbackLocksImage 2024-09-11T14:23:26.101 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapRollbackFailsToLockImage 2024-09-11T14:23:26.102 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapSetReleasesLock 2024-09-11T14:23:26.102 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.FlattenLocksImage 2024-09-11T14:23:26.102 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.FlattenFailsToLockImage 2024-09-11T14:23:26.102 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-11T14:23:26.102 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-11T14:23:26.102 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.AioWriteRequestsLock 2024-09-11T14:23:26.102 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.AioDiscardRequestsLock 2024-09-11T14:23:26.102 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.CancelAsyncResize 2024-09-11T14:23:26.102 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.Metadata 2024-09-11T14:23:26.102 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.MetadataConfApply 2024-09-11T14:23:26.102 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup 2024-09-11T14:23:26.102 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZeros 2024-09-11T14:23:26.102 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZerosMigration 2024-09-11T14:23:26.103 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.ResizeCopyup 2024-09-11T14:23:26.103 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.DiscardCopyup 2024-09-11T14:23:26.103 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.WriteFullCopyup 2024-09-11T14:23:26.103 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.DiffIterateCloneOverwrite 2024-09-11T14:23:26.103 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.TestCoR 2024-09-11T14:23:26.103 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.FlattenNoEmptyObjects 2024-09-11T14:23:26.103 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.PoolMetadataConfApply 2024-09-11T14:23:26.103 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.SparsifyClone 2024-09-11T14:23:26.103 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestInternal.MissingDataPool 2024-09-11T14:23:26.180 INFO:tasks.workunit.client.0.smithi150.stdout:seed 32054 2024-09-11T14:23:26.180 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = TestMirroring.* 2024-09-11T14:23:26.180 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 51 tests from 1 test suite. 2024-09-11T14:23:26.180 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:23:26.180 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 51 tests from TestMirroring 2024-09-11T14:23:28.110 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage 2024-09-11T14:23:31.619 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage (3508 ms) 2024-09-11T14:23:31.619 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool 2024-09-11T14:23:33.385 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool (1767 ms) 2024-09-11T14:23:33.385 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled 2024-09-11T14:23:34.766 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled (1380 ms) 2024-09-11T14:23:34.766 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage 2024-09-11T14:23:36.544 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage (1778 ms) 2024-09-11T14:23:36.544 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap 2024-09-11T14:23:38.077 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap (1533 ms) 2024-09-11T14:23:38.077 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModePool 2024-09-11T14:23:39.648 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModePool (1570 ms) 2024-09-11T14:23:39.648 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled 2024-09-11T14:23:41.500 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled (1852 ms) 2024-09-11T14:23:41.500 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.DisableImageMirrorWithPeer 2024-09-11T14:23:41.500 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_mirroring.cc:482: Skipped 2024-09-11T14:23:41.500 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:41.500 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer (0 ms) 2024-09-11T14:23:41.501 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.DisableJournalingWithPeer 2024-09-11T14:23:41.501 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_mirroring.cc:520: Skipped 2024-09-11T14:23:41.501 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:23:41.501 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer (0 ms) 2024-09-11T14:23:41.501 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling 2024-09-11T14:23:42.653 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling (1153 ms) 2024-09-11T14:23:42.653 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling 2024-09-11T14:23:43.924 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling (1270 ms) 2024-09-11T14:23:43.924 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling 2024-09-11T14:23:46.771 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling (2849 ms) 2024-09-11T14:23:46.771 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock 2024-09-11T14:23:48.650 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock (1879 ms) 2024-09-11T14:23:48.651 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeDisabled 2024-09-11T14:23:50.061 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeDisabled (1411 ms) 2024-09-11T14:23:50.062 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage 2024-09-11T14:23:51.587 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage (1525 ms) 2024-09-11T14:23:51.587 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool 2024-09-11T14:23:53.333 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool (1747 ms) 2024-09-11T14:23:53.334 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling 2024-09-11T14:23:54.661 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling (1328 ms) 2024-09-11T14:23:54.661 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling 2024-09-11T14:23:55.957 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling (1295 ms) 2024-09-11T14:23:55.957 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeDisabled 2024-09-11T14:23:57.573 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeDisabled (1616 ms) 2024-09-11T14:23:57.573 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage 2024-09-11T14:23:59.180 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage (1607 ms) 2024-09-11T14:23:59.180 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled 2024-09-11T14:24:03.023 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled (3843 ms) 2024-09-11T14:24:03.023 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModePool 2024-09-11T14:24:04.842 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModePool (1819 ms) 2024-09-11T14:24:04.842 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModePool 2024-09-11T14:24:06.572 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModePool (1731 ms) 2024-09-11T14:24:06.572 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModeImage 2024-09-11T14:24:08.244 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModeImage (1671 ms) 2024-09-11T14:24:08.244 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode 2024-09-11T14:24:10.773 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode (2529 ms) 2024-09-11T14:24:10.773 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode 2024-09-11T14:24:13.282 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode (2510 ms) 2024-09-11T14:24:13.282 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode 2024-09-11T14:24:15.465 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode (2182 ms) 2024-09-11T14:24:15.465 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode 2024-09-11T14:24:17.899 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode (2435 ms) 2024-09-11T14:24:17.899 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode 2024-09-11T14:24:20.355 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode (2455 ms) 2024-09-11T14:24:20.355 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode 2024-09-11T14:24:23.130 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode (2776 ms) 2024-09-11T14:24:23.131 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageEnabled 2024-09-11T14:24:24.533 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageEnabled (1402 ms) 2024-09-11T14:24:24.533 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDisabled 2024-09-11T14:24:25.783 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDisabled (1251 ms) 2024-09-11T14:24:25.783 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.RemoveImage_With_ImageWithoutJournal 2024-09-11T14:24:26.836 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.RemoveImage_With_ImageWithoutJournal (1053 ms) 2024-09-11T14:24:26.837 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDemoted 2024-09-11T14:24:28.987 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDemoted (2150 ms) 2024-09-11T14:24:28.987 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.TrashMoveRestore_PoolMode 2024-09-11T14:24:31.023 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.TrashMoveRestore_PoolMode (2037 ms) 2024-09-11T14:24:31.023 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled 2024-09-11T14:24:32.835 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled (1812 ms) 2024-09-11T14:24:32.835 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled 2024-09-11T14:24:34.708 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled (1872 ms) 2024-09-11T14:24:34.708 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.MirrorStatusList 2024-09-11T14:24:35.957 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.MirrorStatusList (1250 ms) 2024-09-11T14:24:35.957 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.RemoveBootstrapped 2024-09-11T14:24:37.488 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.RemoveBootstrapped (1530 ms) 2024-09-11T14:24:37.488 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.AioPromoteDemote 2024-09-11T14:24:45.710 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.AioPromoteDemote (8222 ms) 2024-09-11T14:24:45.710 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.AioGetInfo 2024-09-11T14:24:51.570 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.AioGetInfo (5861 ms) 2024-09-11T14:24:51.570 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.AioGetStatus 2024-09-11T14:24:55.291 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.AioGetStatus (3721 ms) 2024-09-11T14:24:55.292 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.SiteName 2024-09-11T14:24:55.298 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.SiteName (6 ms) 2024-09-11T14:24:55.298 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.Bootstrap 2024-09-11T14:25:11.052 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.Bootstrap (15754 ms) 2024-09-11T14:25:11.052 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.PeerDirection 2024-09-11T14:25:11.153 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroring.PeerDirection (99 ms) 2024-09-11T14:25:11.153 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.Snapshot 2024-09-11T14:25:11.153 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_mirroring.cc:1109: Skipped 2024-09-11T14:25:11.153 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:11.153 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.Snapshot (0 ms) 2024-09-11T14:25:11.154 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.SnapshotRemoveOnDisable 2024-09-11T14:25:11.154 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_mirroring.cc:1188: Skipped 2024-09-11T14:25:11.154 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:11.154 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.SnapshotRemoveOnDisable (0 ms) 2024-09-11T14:25:11.154 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.SnapshotUnlinkPeer 2024-09-11T14:25:11.154 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_mirroring.cc:1226: Skipped 2024-09-11T14:25:11.155 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:11.155 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.SnapshotUnlinkPeer (0 ms) 2024-09-11T14:25:11.155 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.SnapshotImageState 2024-09-11T14:25:11.155 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_mirroring.cc:1339: Skipped 2024-09-11T14:25:11.155 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:11.155 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.SnapshotImageState (0 ms) 2024-09-11T14:25:11.155 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.SnapshotPromoteDemote 2024-09-11T14:25:11.155 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_mirroring.cc:1449: Skipped 2024-09-11T14:25:11.156 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:11.156 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.SnapshotPromoteDemote (0 ms) 2024-09-11T14:25:11.156 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroring.AioSnapshotCreate 2024-09-11T14:25:11.156 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_mirroring.cc:1484: Skipped 2024-09-11T14:25:11.156 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:11.156 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.AioSnapshotCreate (0 ms) 2024-09-11T14:25:12.132 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 51 tests from TestMirroring (103041 ms total) 2024-09-11T14:25:12.132 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:25:12.132 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:12.132 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 51 tests from 1 test suite ran. (105951 ms total) 2024-09-11T14:25:12.132 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 43 tests. 2024-09-11T14:25:12.132 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-11T14:25:12.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer 2024-09-11T14:25:12.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer 2024-09-11T14:25:12.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.Snapshot 2024-09-11T14:25:12.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.SnapshotRemoveOnDisable 2024-09-11T14:25:12.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.SnapshotUnlinkPeer 2024-09-11T14:25:12.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.SnapshotImageState 2024-09-11T14:25:12.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.SnapshotPromoteDemote 2024-09-11T14:25:12.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestMirroring.AioSnapshotCreate 2024-09-11T14:25:12.264 INFO:tasks.workunit.client.0.smithi150.stdout:seed 32559 2024-09-11T14:25:12.264 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = TestGroup.* 2024-09-11T14:25:12.264 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-11T14:25:12.264 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:25:12.264 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 13 tests from TestGroup 2024-09-11T14:25:14.236 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestGroup.group_create 2024-09-11T14:25:16.471 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestGroup.group_create (2235 ms) 2024-09-11T14:25:16.471 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestGroup.group_createPP 2024-09-11T14:25:16.654 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestGroup.group_createPP (184 ms) 2024-09-11T14:25:16.654 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestGroup.group_get_id 2024-09-11T14:25:16.808 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestGroup.group_get_id (154 ms) 2024-09-11T14:25:16.808 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestGroup.group_get_idPP 2024-09-11T14:25:16.953 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestGroup.group_get_idPP (145 ms) 2024-09-11T14:25:16.953 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestGroup.add_image 2024-09-11T14:25:17.001 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_Groups.cc:113: Skipped 2024-09-11T14:25:17.001 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:17.001 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.add_image (48 ms) 2024-09-11T14:25:17.002 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestGroup.add_imagePP 2024-09-11T14:25:17.050 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_Groups.cc:195: Skipped 2024-09-11T14:25:17.051 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:17.051 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.add_imagePP (49 ms) 2024-09-11T14:25:17.051 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestGroup.add_snapshot 2024-09-11T14:25:17.098 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_Groups.cc:260: Skipped 2024-09-11T14:25:17.099 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:17.099 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.add_snapshot (48 ms) 2024-09-11T14:25:17.099 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestGroup.add_snapshotPP 2024-09-11T14:25:17.150 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_Groups.cc:413: Skipped 2024-09-11T14:25:17.150 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:17.150 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.add_snapshotPP (52 ms) 2024-09-11T14:25:17.151 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestGroup.snap_get_info 2024-09-11T14:25:17.199 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_Groups.cc:498: Skipped 2024-09-11T14:25:17.199 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:17.199 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.snap_get_info (48 ms) 2024-09-11T14:25:17.199 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestGroup.snap_get_infoPP 2024-09-11T14:25:17.247 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_Groups.cc:553: Skipped 2024-09-11T14:25:17.247 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:17.247 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.snap_get_infoPP (48 ms) 2024-09-11T14:25:17.247 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestGroup.snap_list2 2024-09-11T14:25:17.294 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_Groups.cc:601: Skipped 2024-09-11T14:25:17.294 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:17.295 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.snap_list2 (48 ms) 2024-09-11T14:25:17.295 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestGroup.snap_list2PP 2024-09-11T14:25:17.346 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_Groups.cc:700: Skipped 2024-09-11T14:25:17.346 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:17.347 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.snap_list2PP (52 ms) 2024-09-11T14:25:17.347 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestGroup.snap_list_internal 2024-09-11T14:25:17.396 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_Groups.cc:781: Skipped 2024-09-11T14:25:17.396 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:17.396 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.snap_list_internal (49 ms) 2024-09-11T14:25:18.265 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 13 tests from TestGroup (3160 ms total) 2024-09-11T14:25:18.266 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:25:18.266 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:18.266 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 13 tests from 1 test suite ran. (6001 ms total) 2024-09-11T14:25:18.266 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 4 tests. 2024-09-11T14:25:18.266 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 9 tests, listed below: 2024-09-11T14:25:18.266 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.add_image 2024-09-11T14:25:18.266 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.add_imagePP 2024-09-11T14:25:18.266 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.add_snapshot 2024-09-11T14:25:18.266 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.add_snapshotPP 2024-09-11T14:25:18.266 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.snap_get_info 2024-09-11T14:25:18.266 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.snap_get_infoPP 2024-09-11T14:25:18.266 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.snap_list2 2024-09-11T14:25:18.267 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.snap_list2PP 2024-09-11T14:25:18.267 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestGroup.snap_list_internal 2024-09-11T14:25:18.331 INFO:tasks.workunit.client.0.smithi150.stdout:seed 32608 2024-09-11T14:25:18.331 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = TestMirroringWatcher.* 2024-09-11T14:25:18.332 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-11T14:25:18.332 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:25:18.332 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 2 tests from TestMirroringWatcher 2024-09-11T14:25:20.268 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroringWatcher.ModeUpdated 2024-09-11T14:25:22.519 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroringWatcher.ModeUpdated (2251 ms) 2024-09-11T14:25:22.519 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestMirroringWatcher.ImageStatusUpdated 2024-09-11T14:25:22.666 INFO:tasks.workunit.client.0.smithi150.stdout:[ OK ] TestMirroringWatcher.ImageStatusUpdated (147 ms) 2024-09-11T14:25:23.281 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 2 tests from TestMirroringWatcher (2398 ms total) 2024-09-11T14:25:23.281 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:25:23.281 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:23.281 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 2 tests from 1 test suite ran. (4950 ms total) 2024-09-11T14:25:23.281 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 2 tests. 2024-09-11T14:25:23.351 INFO:tasks.workunit.client.0.smithi150.stdout:seed 32660 2024-09-11T14:25:23.351 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = TestObjectMap.* 2024-09-11T14:25:23.351 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-11T14:25:23.351 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:25:23.352 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 4 tests from TestObjectMap 2024-09-11T14:25:25.010 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-09-11T14:25:27.133 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ObjectMap.cc:38: Skipped 2024-09-11T14:25:27.133 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:27.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenCorrupt (2123 ms) 2024-09-11T14:25:27.133 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-09-11T14:25:27.180 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ObjectMap.cc:66: Skipped 2024-09-11T14:25:27.180 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:27.180 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenTooSmall (46 ms) 2024-09-11T14:25:27.180 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestObjectMap.InvalidateFlagOnDisk 2024-09-11T14:25:27.227 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ObjectMap.cc:95: Skipped 2024-09-11T14:25:27.227 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:27.227 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestObjectMap.InvalidateFlagOnDisk (47 ms) 2024-09-11T14:25:27.227 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-09-11T14:25:27.277 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_ObjectMap.cc:128: Skipped 2024-09-11T14:25:27.277 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:27.278 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall (51 ms) 2024-09-11T14:25:28.025 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 4 tests from TestObjectMap (2268 ms total) 2024-09-11T14:25:28.025 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:25:28.025 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:28.025 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 4 tests from 1 test suite ran. (4674 ms total) 2024-09-11T14:25:28.025 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 0 tests. 2024-09-11T14:25:28.026 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-11T14:25:28.026 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-09-11T14:25:28.026 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-09-11T14:25:28.026 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestObjectMap.InvalidateFlagOnDisk 2024-09-11T14:25:28.026 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-09-11T14:25:28.026 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:25:28.026 INFO:tasks.workunit.client.0.smithi150.stdout: YOU HAVE 1 DISABLED TEST 2024-09-11T14:25:28.026 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:25:28.112 INFO:tasks.workunit.client.0.smithi150.stdout:seed 32709 2024-09-11T14:25:28.112 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = TestOperations.* 2024-09-11T14:25:28.112 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 1 test from 1 test suite. 2024-09-11T14:25:28.112 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:25:28.112 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 1 test from TestOperations 2024-09-11T14:25:30.031 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestOperations.DisableJournalingCorrupt 2024-09-11T14:25:32.163 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_Operations.cc:18: Skipped 2024-09-11T14:25:32.163 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:32.163 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt (2131 ms) 2024-09-11T14:25:33.052 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 1 test from TestOperations (2131 ms total) 2024-09-11T14:25:33.052 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:25:33.052 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:33.052 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 1 test from 1 test suite ran. (4939 ms total) 2024-09-11T14:25:33.052 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 0 tests. 2024-09-11T14:25:33.052 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-11T14:25:33.052 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt 2024-09-11T14:25:33.122 INFO:tasks.workunit.client.0.smithi150.stdout:seed 32758 2024-09-11T14:25:33.123 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = TestTrash.* 2024-09-11T14:25:33.123 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-11T14:25:33.123 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:25:33.123 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 2 tests from TestTrash 2024-09-11T14:25:35.010 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestTrash.UserRemovingSource 2024-09-11T14:25:37.153 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_Trash.cc:36: Skipped 2024-09-11T14:25:37.153 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:37.153 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestTrash.UserRemovingSource (2142 ms) 2024-09-11T14:25:37.153 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestTrash.RestoreMirroringSource 2024-09-11T14:25:37.199 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/test_Trash.cc:93: Skipped 2024-09-11T14:25:37.199 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:37.199 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestTrash.RestoreMirroringSource (46 ms) 2024-09-11T14:25:38.059 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 2 tests from TestTrash (2188 ms total) 2024-09-11T14:25:38.059 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:25:38.059 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:38.059 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 2 tests from 1 test suite ran. (4936 ms total) 2024-09-11T14:25:38.059 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 0 tests. 2024-09-11T14:25:38.059 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-11T14:25:38.059 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestTrash.UserRemovingSource 2024-09-11T14:25:38.060 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestTrash.RestoreMirroringSource 2024-09-11T14:25:38.131 INFO:tasks.workunit.client.0.smithi150.stdout:seed 32808 2024-09-11T14:25:38.131 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = TestJournalEntries.* 2024-09-11T14:25:38.131 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-11T14:25:38.132 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:25:38.132 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 4 tests from TestJournalEntries 2024-09-11T14:25:40.068 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalEntries.AioWrite 2024-09-11T14:25:42.169 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Entries.cc:118: Skipped 2024-09-11T14:25:42.169 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:42.169 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalEntries.AioWrite (2101 ms) 2024-09-11T14:25:42.169 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalEntries.AioDiscard 2024-09-11T14:25:42.217 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Entries.cc:163: Skipped 2024-09-11T14:25:42.217 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:42.217 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard (48 ms) 2024-09-11T14:25:42.217 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalEntries.AioDiscardWithPrune 2024-09-11T14:25:42.268 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Entries.cc:200: Skipped 2024-09-11T14:25:42.269 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:42.269 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune (52 ms) 2024-09-11T14:25:42.269 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalEntries.AioFlush 2024-09-11T14:25:42.317 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Entries.cc:263: Skipped 2024-09-11T14:25:42.317 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:42.317 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalEntries.AioFlush (48 ms) 2024-09-11T14:25:43.082 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 4 tests from TestJournalEntries (2249 ms total) 2024-09-11T14:25:43.082 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:25:43.082 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:43.082 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 4 tests from 1 test suite ran. (4950 ms total) 2024-09-11T14:25:43.082 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 0 tests. 2024-09-11T14:25:43.082 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-11T14:25:43.082 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalEntries.AioWrite 2024-09-11T14:25:43.082 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard 2024-09-11T14:25:43.082 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune 2024-09-11T14:25:43.083 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalEntries.AioFlush 2024-09-11T14:25:43.154 INFO:tasks.workunit.client.0.smithi150.stdout:seed 32857 2024-09-11T14:25:43.154 INFO:tasks.workunit.client.0.smithi150.stdout:Note: Google Test filter = TestJournalReplay.* 2024-09-11T14:25:43.154 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] Running 16 tests from 1 test suite. 2024-09-11T14:25:43.154 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment set-up. 2024-09-11T14:25:43.154 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 16 tests from TestJournalReplay 2024-09-11T14:25:45.013 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.AioDiscardEvent 2024-09-11T14:25:47.203 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:109: Skipped 2024-09-11T14:25:47.204 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.204 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent (2191 ms) 2024-09-11T14:25:47.204 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.AioWriteEvent 2024-09-11T14:25:47.256 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:200: Skipped 2024-09-11T14:25:47.256 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.256 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent (53 ms) 2024-09-11T14:25:47.256 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.AioFlushEvent 2024-09-11T14:25:47.306 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:261: Skipped 2024-09-11T14:25:47.306 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.307 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent (50 ms) 2024-09-11T14:25:47.307 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.SnapCreate 2024-09-11T14:25:47.360 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:307: Skipped 2024-09-11T14:25:47.360 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.360 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate (53 ms) 2024-09-11T14:25:47.360 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.SnapProtect 2024-09-11T14:25:47.408 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:348: Skipped 2024-09-11T14:25:47.408 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.409 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect (49 ms) 2024-09-11T14:25:47.409 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.SnapUnprotect 2024-09-11T14:25:47.456 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:394: Skipped 2024-09-11T14:25:47.457 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.457 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect (48 ms) 2024-09-11T14:25:47.457 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.SnapRename 2024-09-11T14:25:47.507 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:450: Skipped 2024-09-11T14:25:47.507 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.507 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.SnapRename (51 ms) 2024-09-11T14:25:47.507 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.SnapRollback 2024-09-11T14:25:47.555 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:500: Skipped 2024-09-11T14:25:47.555 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.555 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback (47 ms) 2024-09-11T14:25:47.555 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.SnapRemove 2024-09-11T14:25:47.602 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:541: Skipped 2024-09-11T14:25:47.602 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.602 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove (47 ms) 2024-09-11T14:25:47.602 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.Rename 2024-09-11T14:25:47.648 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:590: Skipped 2024-09-11T14:25:47.648 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.649 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.Rename (47 ms) 2024-09-11T14:25:47.649 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.Resize 2024-09-11T14:25:47.702 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:624: Skipped 2024-09-11T14:25:47.702 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.702 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.Resize (53 ms) 2024-09-11T14:25:47.702 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.Flatten 2024-09-11T14:25:47.756 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:657: Skipped 2024-09-11T14:25:47.756 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.756 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.Flatten (54 ms) 2024-09-11T14:25:47.756 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.UpdateFeatures 2024-09-11T14:25:47.804 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:704: Skipped 2024-09-11T14:25:47.804 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.804 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures (48 ms) 2024-09-11T14:25:47.804 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.MetadataSet 2024-09-11T14:25:47.851 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:741: Skipped 2024-09-11T14:25:47.864 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.864 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet (48 ms) 2024-09-11T14:25:47.864 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.MetadataRemove 2024-09-11T14:25:47.904 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:781: Skipped 2024-09-11T14:25:47.904 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.904 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove (52 ms) 2024-09-11T14:25:47.904 INFO:tasks.workunit.client.0.smithi150.stdout:[ RUN ] TestJournalReplay.ObjectPosition 2024-09-11T14:25:47.953 INFO:tasks.workunit.client.0.smithi150.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librbd/journal/test_Replay.cc:824: Skipped 2024-09-11T14:25:47.954 INFO:tasks.workunit.client.0.smithi150.stdout:Skipping due to unmet REQUIRE 2024-09-11T14:25:47.954 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition (50 ms) 2024-09-11T14:25:48.097 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] 16 tests from TestJournalReplay (2941 ms total) 2024-09-11T14:25:48.098 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-11T14:25:48.098 INFO:tasks.workunit.client.0.smithi150.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:48.098 INFO:tasks.workunit.client.0.smithi150.stdout:[==========] 16 tests from 1 test suite ran. (4943 ms total) 2024-09-11T14:25:48.098 INFO:tasks.workunit.client.0.smithi150.stdout:[ PASSED ] 0 tests. 2024-09-11T14:25:48.098 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-11T14:25:48.098 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent 2024-09-11T14:25:48.098 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent 2024-09-11T14:25:48.098 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent 2024-09-11T14:25:48.098 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate 2024-09-11T14:25:48.098 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect 2024-09-11T14:25:48.098 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect 2024-09-11T14:25:48.098 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.SnapRename 2024-09-11T14:25:48.098 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback 2024-09-11T14:25:48.099 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove 2024-09-11T14:25:48.099 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.Rename 2024-09-11T14:25:48.099 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.Resize 2024-09-11T14:25:48.099 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.Flatten 2024-09-11T14:25:48.099 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures 2024-09-11T14:25:48.099 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet 2024-09-11T14:25:48.099 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove 2024-09-11T14:25:48.099 INFO:tasks.workunit.client.0.smithi150.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition 2024-09-11T14:25:48.104 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T14:25:48.104 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T14:25:48.135 INFO:tasks.workunit:Stopping ['rbd/crimson/test_crimson_librbd.sh'] on client.0... 2024-09-11T14:25:48.135 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-11T14:25:48.511 DEBUG:teuthology.parallel:result is None 2024-09-11T14:25:48.512 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T14:25:48.543 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T14:25:48.543 DEBUG:teuthology.orchestra.run.smithi150:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-11T14:25:48.604 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T14:25:48.604 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T14:25:48.621 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T14:25:48.621 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:25:48.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:48.767+0000 7f2cc0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:48.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:48.776+0000 7f2cc0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:49.033 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:25:49.033 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-11T14:25:49.046 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":615,"stamp":"2024-09-11T14:25:48.691587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":10696,"kb_used_data":10696,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156882488,"statfs":{"total":160658620416,"available":160647667712,"internally_reserved":0,"allocated":10952704,"data_stored":10952704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000912"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.297037+0000","last_change":"2024-09-11T14:11:57.623704+0000","last_active":"2024-09-11T14:25:21.297037+0000","last_peered":"2024-09-11T14:25:21.297037+0000","last_clean":"2024-09-11T14:25:21.297037+0000","last_became_active":"2024-09-11T14:11:55.714381+0000","last_became_peered":"2024-09-11T14:11:55.714381+0000","last_unstale":"2024-09-11T14:25:21.297037+0000","last_undegraded":"2024-09-11T14:25:21.297037+0000","last_fullsized":"2024-09-11T14:25:21.297037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.299862+0000","last_change":"2024-09-11T14:11:57.629561+0000","last_active":"2024-09-11T14:25:21.299862+0000","last_peered":"2024-09-11T14:25:21.299862+0000","last_clean":"2024-09-11T14:25:21.299862+0000","last_became_active":"2024-09-11T14:11:55.698337+0000","last_became_peered":"2024-09-11T14:11:55.698337+0000","last_unstale":"2024-09-11T14:25:21.299862+0000","last_undegraded":"2024-09-11T14:25:21.299862+0000","last_fullsized":"2024-09-11T14:25:21.299862+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.297472+0000","last_change":"2024-09-11T14:11:57.624547+0000","last_active":"2024-09-11T14:25:21.297472+0000","last_peered":"2024-09-11T14:25:21.297472+0000","last_clean":"2024-09-11T14:25:21.297472+0000","last_became_active":"2024-09-11T14:11:55.659262+0000","last_became_peered":"2024-09-11T14:11:55.659262+0000","last_unstale":"2024-09-11T14:25:21.297472+0000","last_undegraded":"2024-09-11T14:25:21.297472+0000","last_fullsized":"2024-09-11T14:25:21.297472+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.295592+0000","last_change":"2024-09-11T14:11:57.624865+0000","last_active":"2024-09-11T14:25:21.295592+0000","last_peered":"2024-09-11T14:25:21.295592+0000","last_clean":"2024-09-11T14:25:21.295592+0000","last_became_active":"2024-09-11T14:11:55.673781+0000","last_became_peered":"2024-09-11T14:11:55.673781+0000","last_unstale":"2024-09-11T14:25:21.295592+0000","last_undegraded":"2024-09-11T14:25:21.295592+0000","last_fullsized":"2024-09-11T14:25:21.295592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":500,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.312110+0000","last_change":"2024-09-11T14:11:57.628601+0000","last_active":"2024-09-11T14:25:21.312110+0000","last_peered":"2024-09-11T14:25:21.312110+0000","last_clean":"2024-09-11T14:25:21.312110+0000","last_became_active":"2024-09-11T14:11:55.675250+0000","last_became_peered":"2024-09-11T14:11:55.675250+0000","last_unstale":"2024-09-11T14:25:21.312110+0000","last_undegraded":"2024-09-11T14:25:21.312110+0000","last_fullsized":"2024-09-11T14:25:21.312110+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.312855+0000","last_change":"2024-09-11T14:11:57.623633+0000","last_active":"2024-09-11T14:25:21.312855+0000","last_peered":"2024-09-11T14:25:21.312855+0000","last_clean":"2024-09-11T14:25:21.312855+0000","last_became_active":"2024-09-11T14:11:55.655763+0000","last_became_peered":"2024-09-11T14:11:55.655763+0000","last_unstale":"2024-09-11T14:25:21.312855+0000","last_undegraded":"2024-09-11T14:25:21.312855+0000","last_fullsized":"2024-09-11T14:25:21.312855+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.301718+0000","last_change":"2024-09-11T14:11:57.618994+0000","last_active":"2024-09-11T14:25:21.301718+0000","last_peered":"2024-09-11T14:25:21.301718+0000","last_clean":"2024-09-11T14:25:21.301718+0000","last_became_active":"2024-09-11T14:11:55.710679+0000","last_became_peered":"2024-09-11T14:11:55.710679+0000","last_unstale":"2024-09-11T14:25:21.301718+0000","last_undegraded":"2024-09-11T14:25:21.301718+0000","last_fullsized":"2024-09-11T14:25:21.301718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":499,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.296360+0000","last_change":"2024-09-11T14:11:57.629234+0000","last_active":"2024-09-11T14:25:21.296360+0000","last_peered":"2024-09-11T14:25:21.296360+0000","last_clean":"2024-09-11T14:25:21.296360+0000","last_became_active":"2024-09-11T14:11:55.668793+0000","last_became_peered":"2024-09-11T14:11:55.668793+0000","last_unstale":"2024-09-11T14:25:21.296360+0000","last_undegraded":"2024-09-11T14:25:21.296360+0000","last_fullsized":"2024-09-11T14:25:21.296360+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":570,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.301363+0000","last_change":"2024-09-11T14:11:53.635879+0000","last_active":"2024-09-11T14:25:21.301363+0000","last_peered":"2024-09-11T14:25:21.301363+0000","last_clean":"2024-09-11T14:25:21.301363+0000","last_became_active":"2024-09-11T14:11:53.618322+0000","last_became_peered":"2024-09-11T14:11:53.618322+0000","last_unstale":"2024-09-11T14:25:21.301363+0000","last_undegraded":"2024-09-11T14:25:21.301363+0000","last_fullsized":"2024-09-11T14:25:21.301363+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:52.567120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:52.567120+0000","last_clean_scrub_stamp":"2024-09-11T14:11:52.567120+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160647626752,"internally_reserved":0,"allocated":10993664,"data_stored":10993664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53548675072,"internally_reserved":0,"allocated":4198400,"data_stored":4198400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2784,"kb_used_data":2784,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294944,"statfs":{"total":53552873472,"available":53550022656,"internally_reserved":0,"allocated":2850816,"data_stored":2850816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4076,"kb_used_data":4076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293652,"statfs":{"total":53552873472,"available":53548699648,"internally_reserved":0,"allocated":4173824,"data_stored":4173824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3836,"kb_used_data":3836,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293892,"statfs":{"total":53552873472,"available":53548945408,"internally_reserved":0,"allocated":3928064,"data_stored":3928064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53548675072,"internally_reserved":0,"allocated":4198400,"data_stored":4198400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53548937216,"internally_reserved":0,"allocated":3936256,"data_stored":3936256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53548675072,"internally_reserved":0,"allocated":4198400,"data_stored":4198400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550014464,"internally_reserved":0,"allocated":2859008,"data_stored":2859008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:25:49.047 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:25:49.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:49.150+0000 7f84ced51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:49.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:49.157+0000 7f84ced51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:49.346 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:25:49.347 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-11T14:25:49.360 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":615,"stamp":"2024-09-11T14:25:48.691587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":10696,"kb_used_data":10696,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156882488,"statfs":{"total":160658620416,"available":160647667712,"internally_reserved":0,"allocated":10952704,"data_stored":10952704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000912"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.297037+0000","last_change":"2024-09-11T14:11:57.623704+0000","last_active":"2024-09-11T14:25:21.297037+0000","last_peered":"2024-09-11T14:25:21.297037+0000","last_clean":"2024-09-11T14:25:21.297037+0000","last_became_active":"2024-09-11T14:11:55.714381+0000","last_became_peered":"2024-09-11T14:11:55.714381+0000","last_unstale":"2024-09-11T14:25:21.297037+0000","last_undegraded":"2024-09-11T14:25:21.297037+0000","last_fullsized":"2024-09-11T14:25:21.297037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.299862+0000","last_change":"2024-09-11T14:11:57.629561+0000","last_active":"2024-09-11T14:25:21.299862+0000","last_peered":"2024-09-11T14:25:21.299862+0000","last_clean":"2024-09-11T14:25:21.299862+0000","last_became_active":"2024-09-11T14:11:55.698337+0000","last_became_peered":"2024-09-11T14:11:55.698337+0000","last_unstale":"2024-09-11T14:25:21.299862+0000","last_undegraded":"2024-09-11T14:25:21.299862+0000","last_fullsized":"2024-09-11T14:25:21.299862+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.297472+0000","last_change":"2024-09-11T14:11:57.624547+0000","last_active":"2024-09-11T14:25:21.297472+0000","last_peered":"2024-09-11T14:25:21.297472+0000","last_clean":"2024-09-11T14:25:21.297472+0000","last_became_active":"2024-09-11T14:11:55.659262+0000","last_became_peered":"2024-09-11T14:11:55.659262+0000","last_unstale":"2024-09-11T14:25:21.297472+0000","last_undegraded":"2024-09-11T14:25:21.297472+0000","last_fullsized":"2024-09-11T14:25:21.297472+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.295592+0000","last_change":"2024-09-11T14:11:57.624865+0000","last_active":"2024-09-11T14:25:21.295592+0000","last_peered":"2024-09-11T14:25:21.295592+0000","last_clean":"2024-09-11T14:25:21.295592+0000","last_became_active":"2024-09-11T14:11:55.673781+0000","last_became_peered":"2024-09-11T14:11:55.673781+0000","last_unstale":"2024-09-11T14:25:21.295592+0000","last_undegraded":"2024-09-11T14:25:21.295592+0000","last_fullsized":"2024-09-11T14:25:21.295592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":500,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.312110+0000","last_change":"2024-09-11T14:11:57.628601+0000","last_active":"2024-09-11T14:25:21.312110+0000","last_peered":"2024-09-11T14:25:21.312110+0000","last_clean":"2024-09-11T14:25:21.312110+0000","last_became_active":"2024-09-11T14:11:55.675250+0000","last_became_peered":"2024-09-11T14:11:55.675250+0000","last_unstale":"2024-09-11T14:25:21.312110+0000","last_undegraded":"2024-09-11T14:25:21.312110+0000","last_fullsized":"2024-09-11T14:25:21.312110+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.312855+0000","last_change":"2024-09-11T14:11:57.623633+0000","last_active":"2024-09-11T14:25:21.312855+0000","last_peered":"2024-09-11T14:25:21.312855+0000","last_clean":"2024-09-11T14:25:21.312855+0000","last_became_active":"2024-09-11T14:11:55.655763+0000","last_became_peered":"2024-09-11T14:11:55.655763+0000","last_unstale":"2024-09-11T14:25:21.312855+0000","last_undegraded":"2024-09-11T14:25:21.312855+0000","last_fullsized":"2024-09-11T14:25:21.312855+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.301718+0000","last_change":"2024-09-11T14:11:57.618994+0000","last_active":"2024-09-11T14:25:21.301718+0000","last_peered":"2024-09-11T14:25:21.301718+0000","last_clean":"2024-09-11T14:25:21.301718+0000","last_became_active":"2024-09-11T14:11:55.710679+0000","last_became_peered":"2024-09-11T14:11:55.710679+0000","last_unstale":"2024-09-11T14:25:21.301718+0000","last_undegraded":"2024-09-11T14:25:21.301718+0000","last_fullsized":"2024-09-11T14:25:21.301718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":499,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.296360+0000","last_change":"2024-09-11T14:11:57.629234+0000","last_active":"2024-09-11T14:25:21.296360+0000","last_peered":"2024-09-11T14:25:21.296360+0000","last_clean":"2024-09-11T14:25:21.296360+0000","last_became_active":"2024-09-11T14:11:55.668793+0000","last_became_peered":"2024-09-11T14:11:55.668793+0000","last_unstale":"2024-09-11T14:25:21.296360+0000","last_undegraded":"2024-09-11T14:25:21.296360+0000","last_fullsized":"2024-09-11T14:25:21.296360+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":570,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.301363+0000","last_change":"2024-09-11T14:11:53.635879+0000","last_active":"2024-09-11T14:25:21.301363+0000","last_peered":"2024-09-11T14:25:21.301363+0000","last_clean":"2024-09-11T14:25:21.301363+0000","last_became_active":"2024-09-11T14:11:53.618322+0000","last_became_peered":"2024-09-11T14:11:53.618322+0000","last_unstale":"2024-09-11T14:25:21.301363+0000","last_undegraded":"2024-09-11T14:25:21.301363+0000","last_fullsized":"2024-09-11T14:25:21.301363+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:52.567120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:52.567120+0000","last_clean_scrub_stamp":"2024-09-11T14:11:52.567120+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160647626752,"internally_reserved":0,"allocated":10993664,"data_stored":10993664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53548675072,"internally_reserved":0,"allocated":4198400,"data_stored":4198400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2784,"kb_used_data":2784,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294944,"statfs":{"total":53552873472,"available":53550022656,"internally_reserved":0,"allocated":2850816,"data_stored":2850816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4076,"kb_used_data":4076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293652,"statfs":{"total":53552873472,"available":53548699648,"internally_reserved":0,"allocated":4173824,"data_stored":4173824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3836,"kb_used_data":3836,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293892,"statfs":{"total":53552873472,"available":53548945408,"internally_reserved":0,"allocated":3928064,"data_stored":3928064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53548675072,"internally_reserved":0,"allocated":4198400,"data_stored":4198400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53548937216,"internally_reserved":0,"allocated":3936256,"data_stored":3936256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53548675072,"internally_reserved":0,"allocated":4198400,"data_stored":4198400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550014464,"internally_reserved":0,"allocated":2859008,"data_stored":2859008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:25:49.361 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T14:25:49.361 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:25:49.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:49.462+0000 7f2c40591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:49.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:49.470+0000 7f2c40591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:49.667 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:25:49.667 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-11T14:25:49.680 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":615,"stamp":"2024-09-11T14:25:48.691587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":10696,"kb_used_data":10696,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156882488,"statfs":{"total":160658620416,"available":160647667712,"internally_reserved":0,"allocated":10952704,"data_stored":10952704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000912"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.297037+0000","last_change":"2024-09-11T14:11:57.623704+0000","last_active":"2024-09-11T14:25:21.297037+0000","last_peered":"2024-09-11T14:25:21.297037+0000","last_clean":"2024-09-11T14:25:21.297037+0000","last_became_active":"2024-09-11T14:11:55.714381+0000","last_became_peered":"2024-09-11T14:11:55.714381+0000","last_unstale":"2024-09-11T14:25:21.297037+0000","last_undegraded":"2024-09-11T14:25:21.297037+0000","last_fullsized":"2024-09-11T14:25:21.297037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.299862+0000","last_change":"2024-09-11T14:11:57.629561+0000","last_active":"2024-09-11T14:25:21.299862+0000","last_peered":"2024-09-11T14:25:21.299862+0000","last_clean":"2024-09-11T14:25:21.299862+0000","last_became_active":"2024-09-11T14:11:55.698337+0000","last_became_peered":"2024-09-11T14:11:55.698337+0000","last_unstale":"2024-09-11T14:25:21.299862+0000","last_undegraded":"2024-09-11T14:25:21.299862+0000","last_fullsized":"2024-09-11T14:25:21.299862+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.297472+0000","last_change":"2024-09-11T14:11:57.624547+0000","last_active":"2024-09-11T14:25:21.297472+0000","last_peered":"2024-09-11T14:25:21.297472+0000","last_clean":"2024-09-11T14:25:21.297472+0000","last_became_active":"2024-09-11T14:11:55.659262+0000","last_became_peered":"2024-09-11T14:11:55.659262+0000","last_unstale":"2024-09-11T14:25:21.297472+0000","last_undegraded":"2024-09-11T14:25:21.297472+0000","last_fullsized":"2024-09-11T14:25:21.297472+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.295592+0000","last_change":"2024-09-11T14:11:57.624865+0000","last_active":"2024-09-11T14:25:21.295592+0000","last_peered":"2024-09-11T14:25:21.295592+0000","last_clean":"2024-09-11T14:25:21.295592+0000","last_became_active":"2024-09-11T14:11:55.673781+0000","last_became_peered":"2024-09-11T14:11:55.673781+0000","last_unstale":"2024-09-11T14:25:21.295592+0000","last_undegraded":"2024-09-11T14:25:21.295592+0000","last_fullsized":"2024-09-11T14:25:21.295592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":500,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.312110+0000","last_change":"2024-09-11T14:11:57.628601+0000","last_active":"2024-09-11T14:25:21.312110+0000","last_peered":"2024-09-11T14:25:21.312110+0000","last_clean":"2024-09-11T14:25:21.312110+0000","last_became_active":"2024-09-11T14:11:55.675250+0000","last_became_peered":"2024-09-11T14:11:55.675250+0000","last_unstale":"2024-09-11T14:25:21.312110+0000","last_undegraded":"2024-09-11T14:25:21.312110+0000","last_fullsized":"2024-09-11T14:25:21.312110+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.312855+0000","last_change":"2024-09-11T14:11:57.623633+0000","last_active":"2024-09-11T14:25:21.312855+0000","last_peered":"2024-09-11T14:25:21.312855+0000","last_clean":"2024-09-11T14:25:21.312855+0000","last_became_active":"2024-09-11T14:11:55.655763+0000","last_became_peered":"2024-09-11T14:11:55.655763+0000","last_unstale":"2024-09-11T14:25:21.312855+0000","last_undegraded":"2024-09-11T14:25:21.312855+0000","last_fullsized":"2024-09-11T14:25:21.312855+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.301718+0000","last_change":"2024-09-11T14:11:57.618994+0000","last_active":"2024-09-11T14:25:21.301718+0000","last_peered":"2024-09-11T14:25:21.301718+0000","last_clean":"2024-09-11T14:25:21.301718+0000","last_became_active":"2024-09-11T14:11:55.710679+0000","last_became_peered":"2024-09-11T14:11:55.710679+0000","last_unstale":"2024-09-11T14:25:21.301718+0000","last_undegraded":"2024-09-11T14:25:21.301718+0000","last_fullsized":"2024-09-11T14:25:21.301718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":499,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.296360+0000","last_change":"2024-09-11T14:11:57.629234+0000","last_active":"2024-09-11T14:25:21.296360+0000","last_peered":"2024-09-11T14:25:21.296360+0000","last_clean":"2024-09-11T14:25:21.296360+0000","last_became_active":"2024-09-11T14:11:55.668793+0000","last_became_peered":"2024-09-11T14:11:55.668793+0000","last_unstale":"2024-09-11T14:25:21.296360+0000","last_undegraded":"2024-09-11T14:25:21.296360+0000","last_fullsized":"2024-09-11T14:25:21.296360+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":570,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.301363+0000","last_change":"2024-09-11T14:11:53.635879+0000","last_active":"2024-09-11T14:25:21.301363+0000","last_peered":"2024-09-11T14:25:21.301363+0000","last_clean":"2024-09-11T14:25:21.301363+0000","last_became_active":"2024-09-11T14:11:53.618322+0000","last_became_peered":"2024-09-11T14:11:53.618322+0000","last_unstale":"2024-09-11T14:25:21.301363+0000","last_undegraded":"2024-09-11T14:25:21.301363+0000","last_fullsized":"2024-09-11T14:25:21.301363+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:52.567120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:52.567120+0000","last_clean_scrub_stamp":"2024-09-11T14:11:52.567120+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160647626752,"internally_reserved":0,"allocated":10993664,"data_stored":10993664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53548675072,"internally_reserved":0,"allocated":4198400,"data_stored":4198400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2784,"kb_used_data":2784,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294944,"statfs":{"total":53552873472,"available":53550022656,"internally_reserved":0,"allocated":2850816,"data_stored":2850816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4076,"kb_used_data":4076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293652,"statfs":{"total":53552873472,"available":53548699648,"internally_reserved":0,"allocated":4173824,"data_stored":4173824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3836,"kb_used_data":3836,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293892,"statfs":{"total":53552873472,"available":53548945408,"internally_reserved":0,"allocated":3928064,"data_stored":3928064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53548675072,"internally_reserved":0,"allocated":4198400,"data_stored":4198400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53548937216,"internally_reserved":0,"allocated":3936256,"data_stored":3936256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53548675072,"internally_reserved":0,"allocated":4198400,"data_stored":4198400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550014464,"internally_reserved":0,"allocated":2859008,"data_stored":2859008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:25:49.681 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:25:49.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:49.783+0000 7fa4d0aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:49.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:49.791+0000 7fa4d0aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:49.979 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:25:49.979 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":203,"fsid":"460d6576-fe4d-4af0-a3e1-de2d64971e7b","created":"2024-09-11T14:11:43.902616+0000","modified":"2024-09-11T14:25:48.088093+0000","last_up_change":"2024-09-11T14:11:51.558137+0000","last_in_change":"2024-09-11T14:11:45.784741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:11:52.515741+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:11:53.650031+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"543e464a-b4bc-4d3e-952d-b5fbf540624f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6807","nonce":2294736134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2294736134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":2294736134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2294736134}]},"public_addr":"172.21.15.150:6807/2294736134","cluster_addr":"172.21.15.150:6802/2294736134","heartbeat_back_addr":"172.21.15.150:6811/2294736134","heartbeat_front_addr":"172.21.15.150:6810/2294736134","state":["exists","up"]},{"osd":1,"uuid":"e81b8c2a-85c2-44c1-acca-0d42c45e04b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6803","nonce":2030851888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2030851888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2030851888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6805","nonce":2030851888}]},"public_addr":"172.21.15.150:6803/2030851888","cluster_addr":"172.21.15.150:6804/2030851888","heartbeat_back_addr":"172.21.15.150:6806/2030851888","heartbeat_front_addr":"172.21.15.150:6805/2030851888","state":["exists","up"]},{"osd":2,"uuid":"270c07cb-97e2-4a48-b652-abddda6a76f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":308045515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":308045515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":308045515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":308045515}]},"public_addr":"172.21.15.150:6809/308045515","cluster_addr":"172.21.15.150:6808/308045515","heartbeat_back_addr":"172.21.15.150:6812/308045515","heartbeat_front_addr":"172.21.15.150:6813/308045515","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":3,"snaps":[{"begin":2,"length":13},{"begin":17,"length":1},{"begin":21,"length":1},{"begin":24,"length":1},{"begin":28,"length":8}]},{"pool":4,"snaps":[{"begin":2,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1}]},{"pool":6,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":2,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":1}]},{"pool":20,"snaps":[{"begin":2,"length":4}]},{"pool":21,"snaps":[{"begin":2,"length":1}]},{"pool":22,"snaps":[{"begin":2,"length":1}]},{"pool":23,"snaps":[{"begin":2,"length":1}]},{"pool":24,"snaps":[{"begin":2,"length":1}]},{"pool":25,"snaps":[{"begin":2,"length":1}]},{"pool":26,"snaps":[{"begin":2,"length":1}]},{"pool":27,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:25:50.994 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T14:25:50.994 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:25:51.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:51.109+0000 7f8b522a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:51.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:51.122+0000 7f8b522a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:51.137 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-11T14:25:51.137 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "" 2024-09-11T14:25:51.137 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-11T14:25:51.149 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T14:25:51.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:51.250+0000 7fed1b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:51.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:51.259+0000 7fed1b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:51.445 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T14:25:51.463 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T14:25:51.463 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:25:51.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:51.564+0000 7fd28faec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:51.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:51.576+0000 7fd28faec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:51.593 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-11T14:25:51.593 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "" 2024-09-11T14:25:51.593 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-11T14:25:51.604 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T14:25:51.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:51.706+0000 7f31cab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:51.716 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:51.715+0000 7f31cab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:51.902 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T14:25:51.919 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T14:25:51.919 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:25:52.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:52.027+0000 7f0784d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:52.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:52.039+0000 7f0784d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:52.056 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-11T14:25:52.056 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "" 2024-09-11T14:25:52.056 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-11T14:25:52.068 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T14:25:52.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:52.170+0000 7f0dac551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:52.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:52.179+0000 7f0dac551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:52.366 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T14:25:52.385 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:25:52.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:52.486+0000 7fc83e4ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:52.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:25:52.494+0000 7fc83e4ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:52.678 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:25:52.678 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-11T14:25:52.691 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":616,"stamp":"2024-09-11T14:25:50.691916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":10696,"kb_used_data":10696,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156882488,"statfs":{"total":160658620416,"available":160647667712,"internally_reserved":0,"allocated":10952704,"data_stored":10952704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.682110"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.297037+0000","last_change":"2024-09-11T14:11:57.623704+0000","last_active":"2024-09-11T14:25:21.297037+0000","last_peered":"2024-09-11T14:25:21.297037+0000","last_clean":"2024-09-11T14:25:21.297037+0000","last_became_active":"2024-09-11T14:11:55.714381+0000","last_became_peered":"2024-09-11T14:11:55.714381+0000","last_unstale":"2024-09-11T14:25:21.297037+0000","last_undegraded":"2024-09-11T14:25:21.297037+0000","last_fullsized":"2024-09-11T14:25:21.297037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.299862+0000","last_change":"2024-09-11T14:11:57.629561+0000","last_active":"2024-09-11T14:25:21.299862+0000","last_peered":"2024-09-11T14:25:21.299862+0000","last_clean":"2024-09-11T14:25:21.299862+0000","last_became_active":"2024-09-11T14:11:55.698337+0000","last_became_peered":"2024-09-11T14:11:55.698337+0000","last_unstale":"2024-09-11T14:25:21.299862+0000","last_undegraded":"2024-09-11T14:25:21.299862+0000","last_fullsized":"2024-09-11T14:25:21.299862+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.297472+0000","last_change":"2024-09-11T14:11:57.624547+0000","last_active":"2024-09-11T14:25:21.297472+0000","last_peered":"2024-09-11T14:25:21.297472+0000","last_clean":"2024-09-11T14:25:21.297472+0000","last_became_active":"2024-09-11T14:11:55.659262+0000","last_became_peered":"2024-09-11T14:11:55.659262+0000","last_unstale":"2024-09-11T14:25:21.297472+0000","last_undegraded":"2024-09-11T14:25:21.297472+0000","last_fullsized":"2024-09-11T14:25:21.297472+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.295592+0000","last_change":"2024-09-11T14:11:57.624865+0000","last_active":"2024-09-11T14:25:21.295592+0000","last_peered":"2024-09-11T14:25:21.295592+0000","last_clean":"2024-09-11T14:25:21.295592+0000","last_became_active":"2024-09-11T14:11:55.673781+0000","last_became_peered":"2024-09-11T14:11:55.673781+0000","last_unstale":"2024-09-11T14:25:21.295592+0000","last_undegraded":"2024-09-11T14:25:21.295592+0000","last_fullsized":"2024-09-11T14:25:21.295592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":500,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.312110+0000","last_change":"2024-09-11T14:11:57.628601+0000","last_active":"2024-09-11T14:25:21.312110+0000","last_peered":"2024-09-11T14:25:21.312110+0000","last_clean":"2024-09-11T14:25:21.312110+0000","last_became_active":"2024-09-11T14:11:55.675250+0000","last_became_peered":"2024-09-11T14:11:55.675250+0000","last_unstale":"2024-09-11T14:25:21.312110+0000","last_undegraded":"2024-09-11T14:25:21.312110+0000","last_fullsized":"2024-09-11T14:25:21.312110+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.312855+0000","last_change":"2024-09-11T14:11:57.623633+0000","last_active":"2024-09-11T14:25:21.312855+0000","last_peered":"2024-09-11T14:25:21.312855+0000","last_clean":"2024-09-11T14:25:21.312855+0000","last_became_active":"2024-09-11T14:11:55.655763+0000","last_became_peered":"2024-09-11T14:11:55.655763+0000","last_unstale":"2024-09-11T14:25:21.312855+0000","last_undegraded":"2024-09-11T14:25:21.312855+0000","last_fullsized":"2024-09-11T14:25:21.312855+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":498,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.301718+0000","last_change":"2024-09-11T14:11:57.618994+0000","last_active":"2024-09-11T14:25:21.301718+0000","last_peered":"2024-09-11T14:25:21.301718+0000","last_clean":"2024-09-11T14:25:21.301718+0000","last_became_active":"2024-09-11T14:11:55.710679+0000","last_became_peered":"2024-09-11T14:11:55.710679+0000","last_unstale":"2024-09-11T14:25:21.301718+0000","last_undegraded":"2024-09-11T14:25:21.301718+0000","last_fullsized":"2024-09-11T14:25:21.301718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":499,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.296360+0000","last_change":"2024-09-11T14:11:57.629234+0000","last_active":"2024-09-11T14:25:21.296360+0000","last_peered":"2024-09-11T14:25:21.296360+0000","last_clean":"2024-09-11T14:25:21.296360+0000","last_became_active":"2024-09-11T14:11:55.668793+0000","last_became_peered":"2024-09-11T14:11:55.668793+0000","last_unstale":"2024-09-11T14:25:21.296360+0000","last_undegraded":"2024-09-11T14:25:21.296360+0000","last_fullsized":"2024-09-11T14:25:21.296360+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":570,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-11T14:25:21.301363+0000","last_change":"2024-09-11T14:11:53.635879+0000","last_active":"2024-09-11T14:25:21.301363+0000","last_peered":"2024-09-11T14:25:21.301363+0000","last_clean":"2024-09-11T14:25:21.301363+0000","last_became_active":"2024-09-11T14:11:53.618322+0000","last_became_peered":"2024-09-11T14:11:53.618322+0000","last_unstale":"2024-09-11T14:25:21.301363+0000","last_undegraded":"2024-09-11T14:25:21.301363+0000","last_fullsized":"2024-09-11T14:25:21.301363+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:52.567120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:52.567120+0000","last_clean_scrub_stamp":"2024-09-11T14:11:52.567120+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160647626752,"internally_reserved":0,"allocated":10993664,"data_stored":10993664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53548675072,"internally_reserved":0,"allocated":4198400,"data_stored":4198400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2784,"kb_used_data":2784,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294944,"statfs":{"total":53552873472,"available":53550022656,"internally_reserved":0,"allocated":2850816,"data_stored":2850816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4076,"kb_used_data":4076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293652,"statfs":{"total":53552873472,"available":53548699648,"internally_reserved":0,"allocated":4173824,"data_stored":4173824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3836,"kb_used_data":3836,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293892,"statfs":{"total":53552873472,"available":53548945408,"internally_reserved":0,"allocated":3928064,"data_stored":3928064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53548675072,"internally_reserved":0,"allocated":4198400,"data_stored":4198400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53548937216,"internally_reserved":0,"allocated":3936256,"data_stored":3936256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53548675072,"internally_reserved":0,"allocated":4198400,"data_stored":4198400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550014464,"internally_reserved":0,"allocated":2859008,"data_stored":2859008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:25:52.695 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T14:11:54.578318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:25:52.695 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T14:11:54.578318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:25:52.695 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T14:11:54.578318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:25:52.695 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T14:11:54.578318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:25:52.695 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T14:11:54.578318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:25:52.696 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-11T14:11:54.578318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:25:52.696 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T14:11:54.578318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:25:52.696 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T14:11:54.578318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:25:52.696 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T14:11:52.567120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:25:52.696 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T14:26:12.697 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:26:12.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:26:12.815+0000 7ff89e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:26:12.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:26:12.822+0000 7ff89e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:26:13.005 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:26:13.005 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-11T14:26:13.018 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":627,"stamp":"2024-09-11T14:26:12.696765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":7496,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156885688,"statfs":{"total":160658620416,"available":160650944512,"internally_reserved":0,"allocated":7675904,"data_stored":7675904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002671"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":579,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:48.159843+0000","last_change":"2024-09-11T14:11:57.623704+0000","last_active":"2024-09-11T14:25:48.159843+0000","last_peered":"2024-09-11T14:25:48.159843+0000","last_clean":"2024-09-11T14:25:48.159843+0000","last_became_active":"2024-09-11T14:11:55.714381+0000","last_became_peered":"2024-09-11T14:11:55.714381+0000","last_unstale":"2024-09-11T14:25:48.159843+0000","last_undegraded":"2024-09-11T14:25:48.159843+0000","last_fullsized":"2024-09-11T14:25:48.159843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":579,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:48.142750+0000","last_change":"2024-09-11T14:11:57.629561+0000","last_active":"2024-09-11T14:25:48.142750+0000","last_peered":"2024-09-11T14:25:48.142750+0000","last_clean":"2024-09-11T14:25:48.142750+0000","last_became_active":"2024-09-11T14:11:55.698337+0000","last_became_peered":"2024-09-11T14:11:55.698337+0000","last_unstale":"2024-09-11T14:25:48.142750+0000","last_undegraded":"2024-09-11T14:25:48.142750+0000","last_fullsized":"2024-09-11T14:25:48.142750+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":579,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:48.141856+0000","last_change":"2024-09-11T14:11:57.624547+0000","last_active":"2024-09-11T14:25:48.141856+0000","last_peered":"2024-09-11T14:25:48.141856+0000","last_clean":"2024-09-11T14:25:48.141856+0000","last_became_active":"2024-09-11T14:11:55.659262+0000","last_became_peered":"2024-09-11T14:11:55.659262+0000","last_unstale":"2024-09-11T14:25:48.141856+0000","last_undegraded":"2024-09-11T14:25:48.141856+0000","last_fullsized":"2024-09-11T14:25:48.141856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":579,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:48.167566+0000","last_change":"2024-09-11T14:11:57.624865+0000","last_active":"2024-09-11T14:25:48.167566+0000","last_peered":"2024-09-11T14:25:48.167566+0000","last_clean":"2024-09-11T14:25:48.167566+0000","last_became_active":"2024-09-11T14:11:55.673781+0000","last_became_peered":"2024-09-11T14:11:55.673781+0000","last_unstale":"2024-09-11T14:25:48.167566+0000","last_undegraded":"2024-09-11T14:25:48.167566+0000","last_fullsized":"2024-09-11T14:25:48.167566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":583,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:51.446819+0000","last_change":"2024-09-11T14:25:51.463641+0000","last_active":"2024-09-11T14:25:51.446819+0000","last_peered":"2024-09-11T14:25:51.446819+0000","last_clean":"2024-09-11T14:25:51.446819+0000","last_became_active":"2024-09-11T14:11:55.675250+0000","last_became_peered":"2024-09-11T14:11:55.675250+0000","last_unstale":"2024-09-11T14:25:51.446819+0000","last_undegraded":"2024-09-11T14:25:51.446819+0000","last_fullsized":"2024-09-11T14:25:51.446819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2024-09-11T14:25:51.463433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:51.463433+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":579,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:48.196325+0000","last_change":"2024-09-11T14:11:57.623633+0000","last_active":"2024-09-11T14:25:48.196325+0000","last_peered":"2024-09-11T14:25:48.196325+0000","last_clean":"2024-09-11T14:25:48.196325+0000","last_became_active":"2024-09-11T14:11:55.655763+0000","last_became_peered":"2024-09-11T14:11:55.655763+0000","last_unstale":"2024-09-11T14:25:48.196325+0000","last_undegraded":"2024-09-11T14:25:48.196325+0000","last_fullsized":"2024-09-11T14:25:48.196325+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":579,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:48.161248+0000","last_change":"2024-09-11T14:11:57.618994+0000","last_active":"2024-09-11T14:25:48.161248+0000","last_peered":"2024-09-11T14:25:48.161248+0000","last_clean":"2024-09-11T14:25:48.161248+0000","last_became_active":"2024-09-11T14:11:55.710679+0000","last_became_peered":"2024-09-11T14:11:55.710679+0000","last_unstale":"2024-09-11T14:25:48.161248+0000","last_undegraded":"2024-09-11T14:25:48.161248+0000","last_fullsized":"2024-09-11T14:25:48.161248+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":580,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:48.152172+0000","last_change":"2024-09-11T14:11:57.629234+0000","last_active":"2024-09-11T14:25:48.152172+0000","last_peered":"2024-09-11T14:25:48.152172+0000","last_clean":"2024-09-11T14:25:48.152172+0000","last_became_active":"2024-09-11T14:11:55.668793+0000","last_became_peered":"2024-09-11T14:11:55.668793+0000","last_unstale":"2024-09-11T14:25:48.152172+0000","last_undegraded":"2024-09-11T14:25:48.152172+0000","last_fullsized":"2024-09-11T14:25:48.152172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:54.578318+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":651,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:48.156067+0000","last_change":"2024-09-11T14:11:53.635879+0000","last_active":"2024-09-11T14:25:48.156067+0000","last_peered":"2024-09-11T14:25:48.156067+0000","last_clean":"2024-09-11T14:25:48.156067+0000","last_became_active":"2024-09-11T14:11:53.618322+0000","last_became_peered":"2024-09-11T14:11:53.618322+0000","last_unstale":"2024-09-11T14:25:48.156067+0000","last_undegraded":"2024-09-11T14:25:48.156067+0000","last_fullsized":"2024-09-11T14:25:48.156067+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:11:52.567120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:11:52.567120+0000","last_clean_scrub_stamp":"2024-09-11T14:11:52.567120+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160650944512,"internally_reserved":0,"allocated":7675904,"data_stored":7675904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53549834240,"internally_reserved":0,"allocated":3039232,"data_stored":3039232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1796,"kb_used_data":1796,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295932,"statfs":{"total":53552873472,"available":53551034368,"internally_reserved":0,"allocated":1839104,"data_stored":1839104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2968,"kb_used_data":2968,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294760,"statfs":{"total":53552873472,"available":53549834240,"internally_reserved":0,"allocated":3039232,"data_stored":3039232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2732,"kb_used_data":2732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294996,"statfs":{"total":53552873472,"available":53550075904,"internally_reserved":0,"allocated":2797568,"data_stored":2797568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53549834240,"internally_reserved":0,"allocated":3039232,"data_stored":3039232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550075904,"internally_reserved":0,"allocated":2797568,"data_stored":2797568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53549834240,"internally_reserved":0,"allocated":3039232,"data_stored":3039232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551034368,"internally_reserved":0,"allocated":1839104,"data_stored":1839104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:26:13.019 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T14:11:54.578318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:26:13.019 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T14:11:54.578318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:26:13.019 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T14:11:54.578318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:26:13.019 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T14:11:54.578318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:26:13.019 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-11T14:11:54.578318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:26:13.019 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T14:11:54.578318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:26:13.019 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T14:11:54.578318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:26:13.020 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T14:11:52.567120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=11, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:26:13.020 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T14:26:33.021 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:26:33.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:26:33.138+0000 7f51e1a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:26:33.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:26:33.146+0000 7f51e1a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:26:33.330 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-11T14:26:33.331 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-11T14:26:33.344 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":637,"stamp":"2024-09-11T14:26:32.701138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":7496,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156885688,"statfs":{"total":160658620416,"available":160650944512,"internally_reserved":0,"allocated":7675904,"data_stored":7675904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002676"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":581,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:51.909453+0000","last_change":"2024-09-11T14:25:51.950465+0000","last_active":"2024-09-11T14:25:51.909453+0000","last_peered":"2024-09-11T14:25:51.909453+0000","last_clean":"2024-09-11T14:25:51.909453+0000","last_became_active":"2024-09-11T14:11:55.714381+0000","last_became_peered":"2024-09-11T14:11:55.714381+0000","last_unstale":"2024-09-11T14:25:51.909453+0000","last_undegraded":"2024-09-11T14:25:51.909453+0000","last_fullsized":"2024-09-11T14:25:51.909453+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:51.950271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:51.950271+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":581,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:51.911211+0000","last_change":"2024-09-11T14:25:51.942525+0000","last_active":"2024-09-11T14:25:51.911211+0000","last_peered":"2024-09-11T14:25:51.911211+0000","last_clean":"2024-09-11T14:25:51.911211+0000","last_became_active":"2024-09-11T14:11:55.698337+0000","last_became_peered":"2024-09-11T14:11:55.698337+0000","last_unstale":"2024-09-11T14:25:51.911211+0000","last_undegraded":"2024-09-11T14:25:51.911211+0000","last_fullsized":"2024-09-11T14:25:51.911211+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:51.942330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:51.942330+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":581,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:51.907565+0000","last_change":"2024-09-11T14:25:51.948258+0000","last_active":"2024-09-11T14:25:51.907565+0000","last_peered":"2024-09-11T14:25:51.907565+0000","last_clean":"2024-09-11T14:25:51.907565+0000","last_became_active":"2024-09-11T14:11:55.659262+0000","last_became_peered":"2024-09-11T14:11:55.659262+0000","last_unstale":"2024-09-11T14:25:51.907565+0000","last_undegraded":"2024-09-11T14:25:51.907565+0000","last_fullsized":"2024-09-11T14:25:51.907565+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:51.948077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:51.948077+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":581,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:51.906068+0000","last_change":"2024-09-11T14:25:51.945516+0000","last_active":"2024-09-11T14:25:51.906068+0000","last_peered":"2024-09-11T14:25:51.906068+0000","last_clean":"2024-09-11T14:25:51.906068+0000","last_became_active":"2024-09-11T14:11:55.673781+0000","last_became_peered":"2024-09-11T14:11:55.673781+0000","last_unstale":"2024-09-11T14:25:51.906068+0000","last_undegraded":"2024-09-11T14:25:51.906068+0000","last_fullsized":"2024-09-11T14:25:51.906068+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:51.945322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:51.945322+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":583,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:51.446819+0000","last_change":"2024-09-11T14:25:51.463641+0000","last_active":"2024-09-11T14:25:51.446819+0000","last_peered":"2024-09-11T14:25:51.446819+0000","last_clean":"2024-09-11T14:25:51.446819+0000","last_became_active":"2024-09-11T14:11:55.675250+0000","last_became_peered":"2024-09-11T14:11:55.675250+0000","last_unstale":"2024-09-11T14:25:51.446819+0000","last_undegraded":"2024-09-11T14:25:51.446819+0000","last_fullsized":"2024-09-11T14:25:51.446819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2024-09-11T14:25:51.463433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:51.463433+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":581,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:52.369783+0000","last_change":"2024-09-11T14:25:52.382353+0000","last_active":"2024-09-11T14:25:52.369783+0000","last_peered":"2024-09-11T14:25:52.369783+0000","last_clean":"2024-09-11T14:25:52.369783+0000","last_became_active":"2024-09-11T14:11:55.655763+0000","last_became_peered":"2024-09-11T14:11:55.655763+0000","last_unstale":"2024-09-11T14:25:52.369783+0000","last_undegraded":"2024-09-11T14:25:52.369783+0000","last_fullsized":"2024-09-11T14:25:52.369783+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:52.382185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:52.382185+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":581,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:52.367474+0000","last_change":"2024-09-11T14:25:52.380454+0000","last_active":"2024-09-11T14:25:52.367474+0000","last_peered":"2024-09-11T14:25:52.367474+0000","last_clean":"2024-09-11T14:25:52.367474+0000","last_became_active":"2024-09-11T14:11:55.710679+0000","last_became_peered":"2024-09-11T14:11:55.710679+0000","last_unstale":"2024-09-11T14:25:52.367474+0000","last_undegraded":"2024-09-11T14:25:52.367474+0000","last_fullsized":"2024-09-11T14:25:52.367474+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:52.380276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:52.380276+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":582,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:51.906242+0000","last_change":"2024-09-11T14:25:51.934172+0000","last_active":"2024-09-11T14:25:51.906242+0000","last_peered":"2024-09-11T14:25:51.906242+0000","last_clean":"2024-09-11T14:25:51.906242+0000","last_became_active":"2024-09-11T14:11:55.668793+0000","last_became_peered":"2024-09-11T14:11:55.668793+0000","last_unstale":"2024-09-11T14:25:51.906242+0000","last_undegraded":"2024-09-11T14:25:51.906242+0000","last_fullsized":"2024-09-11T14:25:51.906242+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-11T14:25:51.933859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:51.933859+0000","last_clean_scrub_stamp":"2024-09-11T14:11:54.578318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":653,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-11T14:25:51.903978+0000","last_change":"2024-09-11T14:25:51.971814+0000","last_active":"2024-09-11T14:25:51.903978+0000","last_peered":"2024-09-11T14:25:51.903978+0000","last_clean":"2024-09-11T14:25:51.903978+0000","last_became_active":"2024-09-11T14:11:53.618322+0000","last_became_peered":"2024-09-11T14:11:53.618322+0000","last_unstale":"2024-09-11T14:25:51.903978+0000","last_undegraded":"2024-09-11T14:25:51.903978+0000","last_fullsized":"2024-09-11T14:25:51.903978+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'52","last_scrub_stamp":"2024-09-11T14:25:51.971581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:51.971581+0000","last_clean_scrub_stamp":"2024-09-11T14:11:52.567120+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160650944512,"internally_reserved":0,"allocated":7675904,"data_stored":7675904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53549834240,"internally_reserved":0,"allocated":3039232,"data_stored":3039232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1796,"kb_used_data":1796,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295932,"statfs":{"total":53552873472,"available":53551034368,"internally_reserved":0,"allocated":1839104,"data_stored":1839104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2968,"kb_used_data":2968,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294760,"statfs":{"total":53552873472,"available":53549834240,"internally_reserved":0,"allocated":3039232,"data_stored":3039232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2732,"kb_used_data":2732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294996,"statfs":{"total":53552873472,"available":53550075904,"internally_reserved":0,"allocated":2797568,"data_stored":2797568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53549834240,"internally_reserved":0,"allocated":3039232,"data_stored":3039232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550075904,"internally_reserved":0,"allocated":2797568,"data_stored":2797568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53549834240,"internally_reserved":0,"allocated":3039232,"data_stored":3039232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551034368,"internally_reserved":0,"allocated":1839104,"data_stored":1839104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:26:33.345 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T14:26:33.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:26:33.444+0000 7f2429888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:26:33.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-11T14:26:33.455+0000 7f2429888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:26:33.666 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T14:26:33.667 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T14:26:33.667 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T14:26:33.667 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:26:33.743 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T14:26:33.743 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T14:26:33.743 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:26:33.823 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T14:26:33.823 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T14:26:33.823 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:26:33.894 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T14:26:33.895 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T14:26:33.895 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T14:26:33.895 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:26:33.923 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T14:26:33.924 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T14:26:33.924 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T14:26:33.924 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:26:33.977 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T14:26:33.977 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T14:26:33.978 DEBUG:teuthology.orchestra.run.smithi150:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'is full \(reached quota' | egrep -v '\(POOL_FULL\)' | head -n 1 2024-09-11T14:26:34.048 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-11T14:26:34.048 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T14:26:34.248 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-11T14:26:34.248 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T14:26:34.353 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-11T14:26:34.353 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T14:26:34.427 INFO:tasks.ceph:Archiving mon data... 2024-09-11T14:26:34.429 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901312/data/mon.a.tgz 2024-09-11T14:26:34.429 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-11T14:26:34.444 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.dS5g8UpzJF 2024-09-11T14:26:34.444 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.dS5g8UpzJF 2024-09-11T14:26:34.579 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.dS5g8UpzJF 2024-09-11T14:26:34.662 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.dS5g8UpzJF is 259KB 2024-09-11T14:26:34.757 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.dS5g8UpzJF 2024-09-11T14:26:34.772 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T14:26:34.772 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T14:26:34.892 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T14:26:34.893 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T14:26:34.894 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901312/remote/smithi150/crash 2024-09-11T14:26:34.895 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T14:26:34.957 INFO:tasks.ceph:Compressing logs... 2024-09-11T14:26:34.957 DEBUG:teuthology.orchestra.run.smithi150:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T14:26:35.025 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T14:26:35.025 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29225.log 2024-09-11T14:26:35.025 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29101.log 2024-09-11T14:26:35.025 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.29225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29224.log 2024-09-11T14:26:35.025 INFO:teuthology.orchestra.run.smithi150.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29225.log.gz 2024-09-11T14:26:35.025 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29101.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T14:26:35.025 INFO:teuthology.orchestra.run.smithi150.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29101.log.gz 2024-09-11T14:26:35.026 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28448.log 2024-09-11T14:26:35.026 INFO:teuthology.orchestra.run.smithi150.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29224.log.gz 2024-09-11T14:26:35.026 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33079.log 2024-09-11T14:26:35.026 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.28448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33163.log 2024-09-11T14:26:35.026 INFO:teuthology.orchestra.run.smithi150.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28448.log.gz 2024-09-11T14:26:35.026 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.33079.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27301.log 2024-09-11T14:26:35.026 INFO:teuthology.orchestra.run.smithi150.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33079.log.gz 2024-09-11T14:26:35.026 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.33163.log: gzip 50.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.33163.log.gz 2024-09-11T14:26:35.026 INFO:teuthology.orchestra.run.smithi150.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32608.log 2024-09-11T14:26:35.026 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.tmp-client.admin.27301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32559.log 2024-09-11T14:26:35.026 INFO:teuthology.orchestra.run.smithi150.stderr: 66.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27301.log.gz 2024-09-11T14:26:35.026 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.32608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28250.log 2024-09-11T14:26:35.027 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33205.log 2024-09-11T14:26:35.045 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32808.log 2024-09-11T14:26:35.045 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31633.log 2024-09-11T14:26:35.045 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.32559.log: /var/log/ceph/ceph-client.admin.28250.log: /var/log/ceph/ceph-client.admin.33205.log: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.32608.log.gz 2024-09-11T14:26:35.045 INFO:teuthology.orchestra.run.smithi150.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28250.log.gz 2024-09-11T14:26:35.045 INFO:teuthology.orchestra.run.smithi150.stderr: 50.0%/var/log/ceph/ceph-client.admin.32808.log: -- replaced with /var/log/ceph/ceph-client.admin.33205.log.gz 2024-09-11T14:26:35.045 INFO:teuthology.orchestra.run.smithi150.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.32559.log.gz 2024-09-11T14:26:35.045 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32709.log 2024-09-11T14:26:35.045 INFO:teuthology.orchestra.run.smithi150.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.32808.log.gz 2024-09-11T14:26:35.045 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29351.log 2024-09-11T14:26:35.045 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.31633.log: /var/log/ceph/ceph-client.admin.32709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31505.log 2024-09-11T14:26:35.045 INFO:teuthology.orchestra.run.smithi150.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.31633.log.gz 2024-09-11T14:26:35.046 INFO:teuthology.orchestra.run.smithi150.stderr: 75.8% -- replaced with /var/log/ceph/ceph-client.admin.32709.log.gz 2024-09-11T14:26:35.046 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32857.log 2024-09-11T14:26:35.046 INFO:teuthology.orchestra.run.smithi150.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29351.log.gz 2024-09-11T14:26:35.046 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T14:26:35.046 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.31505.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.31505.log.gz 2024-09-11T14:26:35.046 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.32857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28539.log 2024-09-11T14:26:35.046 INFO:teuthology.orchestra.run.smithi150.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.32857.log.gz 2024-09-11T14:26:35.046 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29223.log 2024-09-11T14:26:35.046 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.28539.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28539.log.gz 2024-09-11T14:26:35.046 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32054.log 2024-09-11T14:26:35.046 INFO:teuthology.orchestra.run.smithi150.stderr: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T14:26:35.047 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29311.log 2024-09-11T14:26:35.047 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29223.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29223.log.gz 2024-09-11T14:26:35.047 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.32054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29437.log 2024-09-11T14:26:35.047 INFO:teuthology.orchestra.run.smithi150.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.32054.log.gz 2024-09-11T14:26:35.047 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28488.log 2024-09-11T14:26:35.047 INFO:teuthology.orchestra.run.smithi150.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29311.log.gz 2024-09-11T14:26:35.047 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28338.log 2024-09-11T14:26:35.047 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29437.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29437.log.gz 2024-09-11T14:26:35.047 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.28488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32660.log 2024-09-11T14:26:35.047 INFO:teuthology.orchestra.run.smithi150.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28488.log.gz 2024-09-11T14:26:35.047 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.28338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31697.log 2024-09-11T14:26:35.047 INFO:teuthology.orchestra.run.smithi150.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28338.log.gz 2024-09-11T14:26:35.047 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.32660.log: gzip -5 78.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.32660.log.gz 2024-09-11T14:26:35.048 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.28866.log 2024-09-11T14:26:35.048 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.31697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32758.log 2024-09-11T14:26:35.048 INFO:teuthology.orchestra.run.smithi150.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.31697.log.gz 2024-09-11T14:26:35.048 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.28866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33457.log 2024-09-11T14:26:35.048 INFO:teuthology.orchestra.run.smithi150.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28866.log.gz 2024-09-11T14:26:35.048 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.32758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28697.log 2024-09-11T14:26:35.048 INFO:teuthology.orchestra.run.smithi150.stderr: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.32758.log.gz 2024-09-11T14:26:35.048 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.33457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33499.log 2024-09-11T14:26:35.048 INFO:teuthology.orchestra.run.smithi150.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33457.log.gz 2024-09-11T14:26:35.048 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.28697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33415.log 2024-09-11T14:26:35.048 INFO:teuthology.orchestra.run.smithi150.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.28697.log.gz 2024-09-11T14:26:35.048 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.33499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31825.log 2024-09-11T14:26:35.048 INFO:teuthology.orchestra.run.smithi150.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33499.log.gz 2024-09-11T14:26:35.049 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.33415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32995.log 2024-09-11T14:26:35.049 INFO:teuthology.orchestra.run.smithi150.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33415.log.gz 2024-09-11T14:26:35.049 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.31825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33373.log 2024-09-11T14:26:35.049 INFO:teuthology.orchestra.run.smithi150.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.31825.log.gz 2024-09-11T14:26:35.049 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.32995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31441.log 2024-09-11T14:26:35.049 INFO:teuthology.orchestra.run.smithi150.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32995.log.gz 2024-09-11T14:26:35.049 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.33373.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-mon.a.log 2024-09-11T14:26:35.049 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33373.log.gz 2024-09-11T14:26:35.049 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.31441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33247.log 2024-09-11T14:26:35.049 INFO:teuthology.orchestra.run.smithi150.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.31441.log.gz 2024-09-11T14:26:35.049 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33289.log 2024-09-11T14:26:35.049 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.33247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28966.log 2024-09-11T14:26:35.049 INFO:teuthology.orchestra.run.smithi150.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33247.log.gz 2024-09-11T14:26:35.050 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.33289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33037.log 2024-09-11T14:26:35.050 INFO:teuthology.orchestra.run.smithi150.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33289.log.gz 2024-09-11T14:26:35.050 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.28966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31761.log 2024-09-11T14:26:35.050 INFO:teuthology.orchestra.run.smithi150.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.28966.log.gz 2024-09-11T14:26:35.050 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.33037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31569.log 2024-09-11T14:26:35.050 INFO:teuthology.orchestra.run.smithi150.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33037.log.gz 2024-09-11T14:26:35.050 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.31761.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T14:26:35.050 INFO:teuthology.orchestra.run.smithi150.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.31761.log.gz 2024-09-11T14:26:35.050 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.31569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29521.log 2024-09-11T14:26:35.050 INFO:teuthology.orchestra.run.smithi150.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.31569.log.gz 2024-09-11T14:26:35.050 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31889.log 2024-09-11T14:26:35.050 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29017.log 2024-09-11T14:26:35.050 INFO:teuthology.orchestra.run.smithi150.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29521.log.gz 2024-09-11T14:26:35.050 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.31889.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T14:26:35.051 INFO:teuthology.orchestra.run.smithi150.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.31889.log.gz 2024-09-11T14:26:35.051 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29017.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29017.log.gz 2024-09-11T14:26:35.051 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33121.log 2024-09-11T14:26:35.051 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33331.log 2024-09-11T14:26:35.051 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.33121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29350.log 2024-09-11T14:26:35.051 INFO:teuthology.orchestra.run.smithi150.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33121.log.gz 2024-09-11T14:26:35.051 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.33331.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33331.log.gz 2024-09-11T14:26:35.051 INFO:teuthology.orchestra.run.smithi150.stderr: --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T14:26:35.051 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29350.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29479.log 2024-09-11T14:26:35.051 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29350.log.gz 2024-09-11T14:26:35.051 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33539.log 2024-09-11T14:26:35.051 INFO:teuthology.orchestra.run.smithi150.stderr: 88.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T14:26:35.051 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29143.log 2024-09-11T14:26:35.052 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29479.log: /var/log/ceph/ceph-client.admin.33539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29059.log 49.6% 2024-09-11T14:26:35.052 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33539.log.gz 2024-09-11T14:26:35.052 INFO:teuthology.orchestra.run.smithi150.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29479.log.gz 2024-09-11T14:26:35.052 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29143.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29143.log.gz 2024-09-11T14:26:35.052 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28727.log 2024-09-11T14:26:35.052 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29059.log: gzip -5 49.6% --verbose -- /var/log/ceph/ceph-client.admin.31953.log 2024-09-11T14:26:35.052 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29059.log.gz 2024-09-11T14:26:35.052 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.28727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29739.log 50.0% 2024-09-11T14:26:35.052 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28727.log.gz 2024-09-11T14:26:35.052 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5/var/log/ceph/ceph-client.admin.31953.log: --verbose -- /var/log/ceph/ceph-client.admin.28922.log 2024-09-11T14:26:35.052 INFO:teuthology.orchestra.run.smithi150.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.31953.log.gz/var/log/ceph/ceph-client.admin.29739.log: 2024-09-11T14:26:35.052 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32002.log 2024-09-11T14:26:35.052 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.28922.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.29739.log.gz 2024-09-11T14:26:35.053 INFO:teuthology.orchestra.run.smithi150.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28922.log.gz 2024-09-11T14:26:35.053 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.32002.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32002.log.gz 2024-09-11T14:26:35.123 INFO:teuthology.orchestra.run.smithi150.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T14:26:35.357 INFO:teuthology.orchestra.run.smithi150.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T14:26:38.250 INFO:teuthology.orchestra.run.smithi150.stderr: 96.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T14:26:39.095 INFO:teuthology.orchestra.run.smithi150.stderr: 96.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T14:26:39.970 INFO:teuthology.orchestra.run.smithi150.stderr: 96.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T14:26:39.972 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-11T14:26:39.972 INFO:teuthology.orchestra.run.smithi150.stderr:real 0m4.959s 2024-09-11T14:26:39.972 INFO:teuthology.orchestra.run.smithi150.stderr:user 0m12.076s 2024-09-11T14:26:39.972 INFO:teuthology.orchestra.run.smithi150.stderr:sys 0m0.610s 2024-09-11T14:26:39.972 INFO:tasks.ceph:Archiving logs... 2024-09-11T14:26:39.973 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901312/remote/smithi150/log 2024-09-11T14:26:39.974 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T14:26:41.442 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T14:26:41.451 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T14:26:41.451 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T14:26:41.507 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T14:26:41.519 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T14:26:41.519 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:26:41.537 INFO:teuthology.orchestra.run.smithi150.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:26:41.541 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:26:41.542 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-09-11T14:26:41.542 INFO:teuthology.orchestra.run.smithi150.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 +537us[ +598us] +/- 35ms 2024-09-11T14:26:41.542 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -435us[ -374us] +/- 66ms 2024-09-11T14:26:41.542 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 -507us[ -447us] +/- 65ms 2024-09-11T14:26:41.542 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:26:41.543 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T14:26:41.553 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T14:26:41.553 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T14:26:41.565 DEBUG:teuthology.orchestra.run.smithi150:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T14:26:41.644 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T14:26:41.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:26:41.672 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T14:26:41.681 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T14:26:41.689 INFO:teuthology.task.internal:Duration was 1314.397083 seconds 2024-09-11T14:26:41.690 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T14:26:41.702 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T14:26:41.703 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T14:26:41.751 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:26:42.015 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T14:26:42.015 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2024-09-11T14:26:42.015 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T14:26:42.075 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T14:26:42.075 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T14:26:42.141 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T14:26:42.141 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T14:26:42.281 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T14:26:42.291 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T14:26:42.291 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T14:26:42.316 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T14:26:42.326 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:26:42.379 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2024-09-11T14:26:42.393 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:26:42.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:26:42.448 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T14:26:42.459 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T14:26:42.460 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901312/remote/smithi150 2024-09-11T14:26:42.460 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T14:26:42.522 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T14:26:42.523 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T14:26:42.572 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T14:26:42.582 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T14:26:42.582 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T14:26:42.593 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T14:26:42.593 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T14:26:42.626 INFO:teuthology.orchestra.run.smithi150.stdout: 265641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 14:26 /home/ubuntu/cephtest 2024-09-11T14:26:42.627 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T14:26:42.638 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T14:26:42.665 INFO:teuthology.run:Summary data: description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rbd_api_tests_old_format} duration: 1314.3970832824707 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-11T14:26:42.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T14:26:42.730 INFO:teuthology.run:pass