2024-09-15T12:06:00.698 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T12:06:00.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T12:06:00.785 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905501 branch: wip-matanb-crimson-testing-59543 description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rbd_api_tests_old_format} email: null first_in_suite: false job_id: '7905501' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-59543 ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug ms: 1 debug osd: 20 osd objectstore: seastore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-1 osd.1: crimson seastar cpu cores: 2-3 osd.2: crimson seastar cpu cores: 4-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_APP_NOT_ENABLED\) - is full \(reached quota - \(POOL_FULL\) sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: crimson sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 1236 sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCVy7BZDUKSVT3fqfqw5auzm2SfqLMpO3jqK2sKc6Zl+uL9qF9nYAikDadYCz10OYE0M31UCN6wx5FzeFZ2/WmM= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rbd/crimson/test_crimson_librbd.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_11:59:21 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T12:06:00.785 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-15T12:06:00.786 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-15T12:06:00.786 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T12:06:00.787 INFO:teuthology.task.internal:Checking packages... 2024-09-15T12:06:00.807 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '81fedcb3b484c843d22ffbc8d179cb567b7083b5' 2024-09-15T12:06:00.807 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T12:06:00.807 INFO:teuthology.packaging:ref: None 2024-09-15T12:06:00.807 INFO:teuthology.packaging:tag: None 2024-09-15T12:06:00.807 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-59543 2024-09-15T12:06:00.807 INFO:teuthology.packaging:sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:06:00.808 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-59543 2024-09-15T12:06:00.949 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4879.g81fedcb3 2024-09-15T12:06:00.951 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T12:06:00.958 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T12:06:00.958 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T12:06:00.977 INFO:teuthology.task.internal:Saving configuration 2024-09-15T12:06:00.987 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T12:06:01.003 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T12:06:01.028 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905501', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 12:00:26.793313', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCVy7BZDUKSVT3fqfqw5auzm2SfqLMpO3jqK2sKc6Zl+uL9qF9nYAikDadYCz10OYE0M31UCN6wx5FzeFZ2/WmM='} 2024-09-15T12:06:01.028 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T12:06:01.034 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-09-15T12:06:01.035 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T12:06:01.070 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcd6570bbe0>, signals=[15]) 2024-09-15T12:06:01.070 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T12:06:01.077 INFO:teuthology.task.internal:Opening connections... 2024-09-15T12:06:01.077 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-09-15T12:06:01.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:06:01.152 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T12:06:01.159 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-09-15T12:06:01.234 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-09-15T12:06:01.234 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-09-15T12:06:01.292 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-09-15T12:06:01.292 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-09-15T12:06:01.292 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-09-15T12:06:01.293 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-09-15T12:06:01.293 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-09-15T12:06:01.293 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-09-15T12:06:01.293 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T12:06:01.293 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-09-15T12:06:01.293 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-09-15T12:06:01.293 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T12:06:01.293 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-09-15T12:06:01.293 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T12:06:01.293 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T12:06:01.293 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T12:06:01.294 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-09-15T12:06:01.315 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T12:06:01.326 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T12:06:01.378 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T12:06:01.378 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-09-15T12:06:01.395 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T12:06:01.401 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T12:06:01.401 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-09-15T12:06:01.457 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T12:06:01.489 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T12:06:01.509 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-15T12:06:01.509 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-15T12:06:01.509 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T12:06:01.525 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:06:01.526 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-09-15T12:06:01.582 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-503.el9.x86_64 2024-09-15T12:06:01.582 INFO:teuthology.task.kernel:Running kernel on smithi071: 5.14.0-503.el9.x86_64 2024-09-15T12:06:01.583 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum install -y kernel 2024-09-15T12:06:03.846 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-15T12:06:05.914 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-15T12:06:10.123 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-15T12:06:12.332 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:01 2024-09-15T12:06:13.277 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-15T12:06:18.716 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-15T12:06:20.798 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T12:06:20.798 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T12:06:20.906 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:06:20.910 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:06:20.910 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-09-15T12:06:20.910 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:06:20.910 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:06:20.910 INFO:teuthology.orchestra.run.smithi071.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T12:06:20.911 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-15T12:06:20.911 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T12:06:20.911 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T12:06:20.911 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T12:06:20.911 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:06:20.911 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:06:20.911 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:06:20.911 INFO:teuthology.orchestra.run.smithi071.stdout:Install 4 Packages 2024-09-15T12:06:20.911 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:06:20.912 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 79 M 2024-09-15T12:06:20.912 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 126 M 2024-09-15T12:06:20.912 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:06:21.476 INFO:teuthology.orchestra.run.smithi071.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 42 kB/s | 23 kB 00:00 2024-09-15T12:06:22.351 INFO:teuthology.orchestra.run.smithi071.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-15T12:06:23.027 INFO:teuthology.orchestra.run.smithi071.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-15T12:06:23.777 INFO:teuthology.orchestra.run.smithi071.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-15T12:06:23.777 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:06:23.777 INFO:teuthology.orchestra.run.smithi071.stdout:Total 27 MB/s | 79 MB 00:02 2024-09-15T12:06:24.467 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:06:24.827 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:06:24.827 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:06:25.789 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:06:25.789 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:06:28.211 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:06:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T12:06:29.021 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:06:31.815 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:06:31.958 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:06:36.801 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:06:36.913 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:06:41.775 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:07:20.026 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:07:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:07:20.567 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:07:20.567 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T12:07:20.567 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:07:20.567 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:07:21.385 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:07:21.386 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:07:21.386 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:07:21.386 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T12:07:21.386 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T12:07:21.386 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T12:07:21.386 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T12:07:21.386 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:07:21.386 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:07:21.729 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T12:07:21.847 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T12:07:21.847 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T12:07:21.848 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T12:07:21.848 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T12:07:21.848 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T12:07:21.849 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-15T12:07:21.849 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T12:07:21.849 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T12:07:21.907 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T12:07:21.908 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T12:07:21.908 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -qi grub2-tools 2024-09-15T12:07:21.950 INFO:teuthology.orchestra.run.smithi071.stdout:Name : grub2-tools 2024-09-15T12:07:21.951 INFO:teuthology.orchestra.run.smithi071.stdout:Epoch : 1 2024-09-15T12:07:21.951 INFO:teuthology.orchestra.run.smithi071.stdout:Version : 2.06 2024-09-15T12:07:21.951 INFO:teuthology.orchestra.run.smithi071.stdout:Release : 82.el9 2024-09-15T12:07:21.951 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: x86_64 2024-09-15T12:07:21.951 INFO:teuthology.orchestra.run.smithi071.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T12:07:21.951 INFO:teuthology.orchestra.run.smithi071.stdout:Group : Unspecified 2024-09-15T12:07:21.951 INFO:teuthology.orchestra.run.smithi071.stdout:Size : 8274670 2024-09-15T12:07:21.951 INFO:teuthology.orchestra.run.smithi071.stdout:License : GPLv3+ 2024-09-15T12:07:21.951 INFO:teuthology.orchestra.run.smithi071.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T12:07:21.951 INFO:teuthology.orchestra.run.smithi071.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T12:07:21.951 INFO:teuthology.orchestra.run.smithi071.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T12:07:21.952 INFO:teuthology.orchestra.run.smithi071.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T12:07:21.952 INFO:teuthology.orchestra.run.smithi071.stdout:Packager : builder@centos.org 2024-09-15T12:07:21.952 INFO:teuthology.orchestra.run.smithi071.stdout:Vendor : CentOS 2024-09-15T12:07:21.952 INFO:teuthology.orchestra.run.smithi071.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T12:07:21.952 INFO:teuthology.orchestra.run.smithi071.stdout:Summary : Support tools for GRUB. 2024-09-15T12:07:21.952 INFO:teuthology.orchestra.run.smithi071.stdout:Description : 2024-09-15T12:07:21.952 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:07:21.952 INFO:teuthology.orchestra.run.smithi071.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T12:07:21.952 INFO:teuthology.orchestra.run.smithi071.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T12:07:21.952 INFO:teuthology.orchestra.run.smithi071.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T12:07:21.952 INFO:teuthology.orchestra.run.smithi071.stdout:hardware devices. 2024-09-15T12:07:21.952 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:07:21.952 INFO:teuthology.orchestra.run.smithi071.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T12:07:21.953 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T12:07:21.953 INFO:teuthology.task.kernel:Updating grub on smithi071 to boot 5.14.0-505.el9.x86_64 2024-09-15T12:07:21.953 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T12:07:22.629 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2024-09-15T12:07:23.948 INFO:teuthology.orchestra.run.smithi071.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T12:07:23.978 INFO:teuthology.orchestra.run.smithi071.stderr:done 2024-09-15T12:07:24.051 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-09-15T12:07:24.066 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.U34PnTvu3Y 2024-09-15T12:07:24.067 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.U34PnTvu3Y 2024-09-15T12:07:24.134 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.U34PnTvu3Y 2024-09-15T12:07:24.271 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.U34PnTvu3Y is 6KB 2024-09-15T12:07:24.320 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.U34PnTvu3Y 2024-09-15T12:07:24.335 DEBUG:teuthology.orchestra.run.smithi071:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T12:07:24.422 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T12:07:24.423 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T12:07:24.423 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T12:07:24.423 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T12:07:24.424 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T12:07:24.538 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2024-09-15T12:07:54.569 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-15T12:07:54.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-15T12:07:54.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:08:13.117 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-09-15T12:08:22.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-15T12:08:22.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:08:25.181 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-09-15T12:08:37.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-15T12:08:37.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:08:55.617 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-09-15T12:09:10.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-15T12:09:10.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:09:11.083 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-15T12:09:11.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-15T12:09:11.481 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-15T12:09:11.482 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-09-15T12:09:11.496 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-505.el9.x86_64 2024-09-15T12:09:11.496 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T12:09:11.497 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T12:09:11.497 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T12:09:12.498 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-15T12:09:12.498 DEBUG:teuthology.orchestra.run.smithi071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T12:09:12.593 INFO:teuthology.orchestra.run.smithi071.stdout:ttyS1 2024-09-15T12:09:12.617 DEBUG:teuthology.parallel:result is None 2024-09-15T12:09:12.617 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T12:09:12.628 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T12:09:12.628 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T12:09:12.642 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T12:09:12.654 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T12:09:12.676 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T12:09:12.676 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T12:09:12.730 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T12:09:12.740 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T12:09:12.740 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T12:09:12.885 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T12:09:12.895 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T12:09:12.897 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T12:09:12.904 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T12:09:12.904 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T12:09:12.930 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T12:09:12.966 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T12:09:12.966 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T12:09:12.989 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T12:09:13.079 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T12:09:13.133 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T12:09:13.252 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T12:09:13.326 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:09:13.326 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T12:09:13.391 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-09-15T12:09:13.534 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T12:09:13.922 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T12:09:13.930 INFO:teuthology.task.internal:Starting timer... 2024-09-15T12:09:13.930 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T12:09:13.980 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T12:09:14.027 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-15T12:09:14.027 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-09-15T12:09:14.138 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-09-15T12:09:14.140 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T12:09:14.140 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-09-15T12:09:14.160 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-09-15T12:09:14.160 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi071.front.sepia.ceph.com': 'permissive'} 2024-09-15T12:09:14.160 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T12:09:14.229 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:09:14.229 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T12:09:14.230 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-09-15T12:09:14.314 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T12:09:14.324 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T12:09:14.335 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T12:09:14.335 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi071.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T12:13:14.602 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi071.front.sepia.ceph.com')] 2024-09-15T12:13:14.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-15T12:13:14.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:13:14.727 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-15T12:13:14.772 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-15T12:13:14.772 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T12:13:14.792 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T12:13:14.793 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T12:13:14.793 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T12:13:14.843 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T12:13:14.857 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T12:13:14.881 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-09-15T12:13:14.894 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-09-15T12:13:14.907 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T12:13:14.919 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T12:13:14.981 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-15T12:13:14.986 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T12:13:14.986 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-15T12:13:14.986 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:13:14.986 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:13:14.986 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:13:14.986 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:13:14.986 INFO:teuthology.run_tasks:Running task install... 2024-09-15T12:13:15.006 DEBUG:teuthology.task.install:project ceph 2024-09-15T12:13:15.006 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}} 2024-09-15T12:13:15.006 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'} 2024-09-15T12:13:15.006 INFO:teuthology.task.install:Using flavor: crimson 2024-09-15T12:13:15.023 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T12:13:15.023 INFO:teuthology.task.install:extra packages: [] 2024-09-15T12:13:15.031 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-15T12:13:15.032 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:13:15.188 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-15T12:13:15.188 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-15T12:13:15.327 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T12:13:15.328 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:13:15.328 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T12:13:15.355 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-15T12:13:15.356 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T12:13:15.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T12:13:15.497 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T12:13:15.561 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2024-09-15T12:13:15.563 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2024-09-15T12:13:15.793 INFO:teuthology.orchestra.run.smithi071.stdout:45 files removed 2024-09-15T12:13:15.820 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw 2024-09-15T12:13:16.385 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 314 kB/s | 88 kB 00:00 2024-09-15T12:13:16.677 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-15T12:13:16.953 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 8.7 kB/s | 2.1 kB 00:00 2024-09-15T12:13:19.394 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.2 MB 00:02 2024-09-15T12:13:21.298 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-15T12:13:25.590 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-15T12:13:27.165 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 19 kB 00:00 2024-09-15T12:13:28.203 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-15T12:13:33.641 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-15T12:13:36.009 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:13:36.019 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:13:36.019 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-15T12:13:36.020 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:13:36.020 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:13:36.020 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-15T12:13:36.020 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2024-09-15T12:13:36.020 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-15T12:13:36.020 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-15T12:13:36.020 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-15T12:13:36.020 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T12:13:36.020 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-15T12:13:36.020 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-15T12:13:36.020 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-15T12:13:36.020 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T12:13:36.022 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T12:13:36.023 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T12:13:36.023 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-15T12:13:36.023 INFO:teuthology.orchestra.run.smithi071.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-15T12:13:36.023 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T12:13:36.023 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T12:13:36.023 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T12:13:36.023 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-15T12:13:36.023 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T12:13:36.023 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-15T12:13:36.023 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T12:13:36.023 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T12:13:36.023 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T12:13:36.023 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-15T12:13:36.024 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-15T12:13:36.024 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-15T12:13:36.024 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T12:13:36.024 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-15T12:13:36.024 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-15T12:13:36.024 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-15T12:13:36.024 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T12:13:36.024 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T12:13:36.024 INFO:teuthology.orchestra.run.smithi071.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T12:13:36.024 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T12:13:36.024 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2024-09-15T12:13:36.027 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T12:13:36.028 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:13:36.028 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:13:36.028 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:13:36.028 INFO:teuthology.orchestra.run.smithi071.stdout:Install 31 Packages 2024-09-15T12:13:36.028 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 2 Packages 2024-09-15T12:13:36.028 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:13:36.028 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 60 M 2024-09-15T12:13:36.028 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:13:37.092 INFO:teuthology.orchestra.run.smithi071.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 7.7 MB/s | 6.1 MB 00:00 2024-09-15T12:13:37.134 INFO:teuthology.orchestra.run.smithi071.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 602 kB/s | 25 kB 00:00 2024-09-15T12:13:37.334 INFO:teuthology.orchestra.run.smithi071.stdout:(3/33): ceph-common-19.3.0-4879.g81fedcb3.el9.x 19 MB/s | 20 MB 00:01 2024-09-15T12:13:37.443 INFO:teuthology.orchestra.run.smithi071.stdout:(4/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 9.2 MB/s | 10 MB 00:01 2024-09-15T12:13:37.476 INFO:teuthology.orchestra.run.smithi071.stdout:(5/33): libradosstriper1-19.3.0-4879.g81fedcb3. 3.9 MB/s | 558 kB 00:00 2024-09-15T12:13:37.510 INFO:teuthology.orchestra.run.smithi071.stdout:(6/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 2.1 MB/s | 809 kB 00:00 2024-09-15T12:13:37.535 INFO:teuthology.orchestra.run.smithi071.stdout:(7/33): python3-ceph-argparse-19.3.0-4879.g81fe 769 kB/s | 45 kB 00:00 2024-09-15T12:13:37.569 INFO:teuthology.orchestra.run.smithi071.stdout:(8/33): python3-ceph-common-19.3.0-4879.g81fedc 2.4 MB/s | 143 kB 00:00 2024-09-15T12:13:37.595 INFO:teuthology.orchestra.run.smithi071.stdout:(9/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 2.7 MB/s | 160 kB 00:00 2024-09-15T12:13:37.621 INFO:teuthology.orchestra.run.smithi071.stdout:(10/33): python3-rados-19.3.0-4879.g81fedcb3.el 6.1 MB/s | 315 kB 00:00 2024-09-15T12:13:37.645 INFO:teuthology.orchestra.run.smithi071.stdout:(11/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 5.9 MB/s | 302 kB 00:00 2024-09-15T12:13:37.671 INFO:teuthology.orchestra.run.smithi071.stdout:(12/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T12:13:37.762 INFO:teuthology.orchestra.run.smithi071.stdout:(13/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_ 17 MB/s | 5.4 MB 00:00 2024-09-15T12:13:37.837 INFO:teuthology.orchestra.run.smithi071.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 556 kB/s | 107 kB 00:00 2024-09-15T12:13:37.888 INFO:teuthology.orchestra.run.smithi071.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-09-15T12:13:37.922 INFO:teuthology.orchestra.run.smithi071.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 680 kB/s | 171 kB 00:00 2024-09-15T12:13:37.946 INFO:teuthology.orchestra.run.smithi071.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 871 kB/s | 160 kB 00:00 2024-09-15T12:13:37.997 INFO:teuthology.orchestra.run.smithi071.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 844 kB/s | 42 kB 00:00 2024-09-15T12:13:38.047 INFO:teuthology.orchestra.run.smithi071.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-15T12:13:38.089 INFO:teuthology.orchestra.run.smithi071.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-15T12:13:38.114 INFO:teuthology.orchestra.run.smithi071.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 538 kB/s | 36 kB 00:00 2024-09-15T12:13:38.139 INFO:teuthology.orchestra.run.smithi071.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-09-15T12:13:38.165 INFO:teuthology.orchestra.run.smithi071.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 627 kB/s | 47 kB 00:00 2024-09-15T12:13:38.232 INFO:teuthology.orchestra.run.smithi071.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-15T12:13:38.257 INFO:teuthology.orchestra.run.smithi071.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-15T12:13:38.282 INFO:teuthology.orchestra.run.smithi071.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 254 kB/s | 26 kB 00:00 2024-09-15T12:13:38.307 INFO:teuthology.orchestra.run.smithi071.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-15T12:13:38.341 INFO:teuthology.orchestra.run.smithi071.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-15T12:13:38.408 INFO:teuthology.orchestra.run.smithi071.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-15T12:13:38.450 INFO:teuthology.orchestra.run.smithi071.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-15T12:13:38.525 INFO:teuthology.orchestra.run.smithi071.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-15T12:13:38.726 INFO:teuthology.orchestra.run.smithi071.stdout:(32/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 14 MB/s | 3.8 MB 00:00 2024-09-15T12:13:38.775 INFO:teuthology.orchestra.run.smithi071.stdout:(33/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 9.4 MB/s | 3.5 MB 00:00 2024-09-15T12:13:38.795 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:13:38.795 INFO:teuthology.orchestra.run.smithi071.stdout:Total 22 MB/s | 60 MB 00:02 2024-09-15T12:13:38.894 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:13:38.930 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:13:38.930 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:13:39.591 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:13:39.591 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:13:41.096 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:13:41.613 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-15T12:13:41.703 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:13:41.778 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:13:41.867 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-15T12:13:41.896 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:13:41.958 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:13:41.996 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-15T12:13:42.045 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-15T12:13:42.075 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-15T12:13:42.106 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-15T12:13:42.126 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-15T12:13:42.327 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-15T12:13:42.364 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-15T12:13:42.399 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-15T12:13:42.442 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-15T12:13:42.472 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-15T12:13:42.551 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-15T12:13:42.578 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-15T12:13:42.647 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-15T12:13:42.686 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-15T12:13:42.791 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-15T12:13:42.825 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-15T12:13:42.868 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-15T12:13:42.909 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-15T12:13:42.938 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-15T12:13:42.984 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-15T12:13:43.338 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-15T12:13:43.392 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-15T12:13:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-15T12:13:43.518 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-15T12:13:43.566 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-15T12:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-15T12:13:44.169 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-15T12:13:44.224 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-15T12:13:44.293 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-15T12:13:44.330 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-15T12:13:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:13:46.951 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:13:47.656 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:13:47.688 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-15T12:13:47.781 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-15T12:13:47.782 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T12:13:47.782 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T12:13:47.782 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:13:47.823 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:13:58.196 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:13:58.196 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2024-09-15T12:13:58.196 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2024-09-15T12:13:58.196 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2024-09-15T12:13:58.196 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2024-09-15T12:13:58.196 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2024-09-15T12:13:58.197 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /root 2024-09-15T12:13:58.197 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2024-09-15T12:13:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:13:59.322 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-15T12:13:59.346 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-15T12:13:59.346 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:13:59.346 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T12:13:59.346 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T12:13:59.346 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T12:13:59.346 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:13:59.348 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-15T12:13:59.431 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-15T12:13:59.432 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:14:00.772 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:14:00.772 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-15T12:14:00.772 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:14:00.772 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-15T12:14:00.773 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:14:00.773 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-15T12:14:00.773 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-15T12:14:00.773 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-15T12:14:00.773 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-15T12:14:00.773 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-15T12:14:00.773 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-15T12:14:00.773 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-15T12:14:00.773 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-15T12:14:00.773 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-15T12:14:00.773 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-15T12:14:00.773 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-15T12:14:00.773 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-15T12:14:00.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-15T12:14:00.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-15T12:14:00.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-15T12:14:00.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-15T12:14:00.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-15T12:14:00.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-15T12:14:00.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-15T12:14:00.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-15T12:14:00.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-15T12:14:00.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-15T12:14:00.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-15T12:14:00.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-15T12:14:00.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-15T12:14:00.775 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-15T12:14:00.775 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-15T12:14:00.775 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:14:00.775 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-15T12:14:00.775 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-15T12:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2024-09-15T12:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T12:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T12:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T12:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T12:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-15T12:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T12:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T12:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T12:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T12:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T12:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T12:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T12:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T12:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T12:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T12:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T12:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T12:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T12:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:14:02.118 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-test 2024-09-15T12:14:02.687 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:29 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:14:02.822 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:14:02.826 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:14:02.826 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-15T12:14:02.827 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:14:02.827 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:14:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-15T12:14:02.827 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-15T12:14:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-15T12:14:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-15T12:14:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-15T12:14:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-15T12:14:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T12:14:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T12:14:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T12:14:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-15T12:14:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:14:02.828 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:14:02.828 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:14:02.828 INFO:teuthology.orchestra.run.smithi071.stdout:Install 9 Packages 2024-09-15T12:14:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:14:02.828 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 87 M 2024-09-15T12:14:02.828 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 797 M 2024-09-15T12:14:02.828 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:14:03.219 INFO:teuthology.orchestra.run.smithi071.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 781 kB/s | 94 kB 00:00 2024-09-15T12:14:03.328 INFO:teuthology.orchestra.run.smithi071.stdout:(2/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 764 kB/s | 175 kB 00:00 2024-09-15T12:14:04.045 INFO:teuthology.orchestra.run.smithi071.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 255 kB/s | 183 kB 00:00 2024-09-15T12:14:04.098 INFO:teuthology.orchestra.run.smithi071.stdout:(4/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 587 kB/s | 513 kB 00:00 2024-09-15T12:14:05.570 INFO:teuthology.orchestra.run.smithi071.stdout:(5/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 34 MB/s | 85 MB 00:02 2024-09-15T12:14:05.612 INFO:teuthology.orchestra.run.smithi071.stdout:(6/9): socat-1.7.4.1-6.el9.x86_64.rpm 201 kB/s | 304 kB 00:01 2024-09-15T12:14:05.654 INFO:teuthology.orchestra.run.smithi071.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.9 MB/s | 122 kB 00:00 2024-09-15T12:14:05.779 INFO:teuthology.orchestra.run.smithi071.stdout:(8/9): protobuf-3.14.0-13.el9.x86_64.rpm 596 kB/s | 1.0 MB 00:01 2024-09-15T12:14:06.201 INFO:teuthology.orchestra.run.smithi071.stdout:(9/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2024-09-15T12:14:06.201 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:14:06.202 INFO:teuthology.orchestra.run.smithi071.stdout:Total 26 MB/s | 87 MB 00:03 2024-09-15T12:14:06.285 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:14:06.306 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:14:06.306 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:14:06.925 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:14:06.926 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:14:07.810 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:14:07.886 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-15T12:14:07.940 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-15T12:14:07.992 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-15T12:14:08.027 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-15T12:14:08.058 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-15T12:14:08.091 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-15T12:14:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-15T12:14:08.217 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-15T12:14:08.251 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-15T12:14:19.510 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-15T12:14:19.589 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-15T12:14:26.149 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-15T12:14:26.149 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-15T12:14:26.149 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-15T12:14:26.149 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-15T12:14:26.149 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-15T12:14:26.149 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-15T12:14:26.149 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-15T12:14:26.149 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-15T12:14:26.150 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-15T12:14:26.549 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-15T12:14:26.549 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:14:26.549 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:14:26.549 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:26.549 INFO:teuthology.orchestra.run.smithi071.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-15T12:14:26.550 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:14:26.550 INFO:teuthology.orchestra.run.smithi071.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-15T12:14:26.550 INFO:teuthology.orchestra.run.smithi071.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-15T12:14:26.550 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T12:14:26.550 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T12:14:26.550 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T12:14:26.550 INFO:teuthology.orchestra.run.smithi071.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-15T12:14:26.550 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:14:26.550 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:14:26.939 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph 2024-09-15T12:14:27.506 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:54 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:14:27.641 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:14:27.644 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:14:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-15T12:14:27.644 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:14:27.644 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:14:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-15T12:14:27.644 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-15T12:14:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-15T12:14:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-15T12:14:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-15T12:14:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-15T12:14:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-15T12:14:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T12:14:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T12:14:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T12:14:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T12:14:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T12:14:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T12:14:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T12:14:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T12:14:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T12:14:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T12:14:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections 2024-09-15T12:14:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-15T12:14:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T12:14:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T12:14:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T12:14:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T12:14:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T12:14:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T12:14:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T12:14:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T12:14:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T12:14:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T12:14:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T12:14:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T12:14:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T12:14:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T12:14:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T12:14:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T12:14:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T12:14:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T12:14:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T12:14:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T12:14:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:14:27.647 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:14:27.647 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:14:27.647 INFO:teuthology.orchestra.run.smithi071.stdout:Install 37 Packages 2024-09-15T12:14:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:14:27.648 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 84 M 2024-09-15T12:14:27.648 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 897 M 2024-09-15T12:14:27.648 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:14:28.878 INFO:teuthology.orchestra.run.smithi071.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 18 kB/s | 6.5 kB 00:00 2024-09-15T12:14:29.594 INFO:teuthology.orchestra.run.smithi071.stdout:(2/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 2.0 MB/s | 2.2 MB 00:01 2024-09-15T12:14:29.636 INFO:teuthology.orchestra.run.smithi071.stdout:(3/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 1.4 MB/s | 1.6 MB 00:01 2024-09-15T12:14:29.803 INFO:teuthology.orchestra.run.smithi071.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 1.7 MB/s | 291 kB 00:00 2024-09-15T12:14:29.946 INFO:teuthology.orchestra.run.smithi071.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-15T12:14:30.504 INFO:teuthology.orchestra.run.smithi071.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 2.2 MB/s | 1.2 MB 00:00 2024-09-15T12:14:30.588 INFO:teuthology.orchestra.run.smithi071.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-09-15T12:14:30.663 INFO:teuthology.orchestra.run.smithi071.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.8 MB/s | 135 kB 00:00 2024-09-15T12:14:30.738 INFO:teuthology.orchestra.run.smithi071.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.6 MB/s | 125 kB 00:00 2024-09-15T12:14:30.855 INFO:teuthology.orchestra.run.smithi071.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-09-15T12:14:31.148 INFO:teuthology.orchestra.run.smithi071.stdout:(11/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86 2.3 MB/s | 5.1 MB 00:02 2024-09-15T12:14:31.406 INFO:teuthology.orchestra.run.smithi071.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 342 kB/s | 188 kB 00:00 2024-09-15T12:14:31.525 INFO:teuthology.orchestra.run.smithi071.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 298 kB/s | 35 kB 00:00 2024-09-15T12:14:31.631 INFO:teuthology.orchestra.run.smithi071.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 713 kB/s | 77 kB 00:00 2024-09-15T12:14:31.690 INFO:teuthology.orchestra.run.smithi071.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 318 kB/s | 172 kB 00:00 2024-09-15T12:14:31.743 INFO:teuthology.orchestra.run.smithi071.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-09-15T12:14:31.799 INFO:teuthology.orchestra.run.smithi071.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-15T12:14:31.824 INFO:teuthology.orchestra.run.smithi071.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-15T12:14:31.866 INFO:teuthology.orchestra.run.smithi071.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-09-15T12:14:31.900 INFO:teuthology.orchestra.run.smithi071.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 5.3 MB/s | 172 kB 00:00 2024-09-15T12:14:31.933 INFO:teuthology.orchestra.run.smithi071.stdout:(21/37): luarocks-3.9.2-5.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-09-15T12:14:31.958 INFO:teuthology.orchestra.run.smithi071.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 430 kB/s | 11 kB 00:00 2024-09-15T12:14:31.975 INFO:teuthology.orchestra.run.smithi071.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-15T12:14:32.002 INFO:teuthology.orchestra.run.smithi071.stdout:(24/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.5 MB/s | 358 kB 00:00 2024-09-15T12:14:32.018 INFO:teuthology.orchestra.run.smithi071.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 553 kB/s | 23 kB 00:00 2024-09-15T12:14:32.035 INFO:teuthology.orchestra.run.smithi071.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 579 kB/s | 19 kB 00:00 2024-09-15T12:14:32.060 INFO:teuthology.orchestra.run.smithi071.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 472 kB/s | 20 kB 00:00 2024-09-15T12:14:32.085 INFO:teuthology.orchestra.run.smithi071.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-09-15T12:14:32.111 INFO:teuthology.orchestra.run.smithi071.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-15T12:14:32.136 INFO:teuthology.orchestra.run.smithi071.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 660 kB/s | 16 kB 00:00 2024-09-15T12:14:32.161 INFO:teuthology.orchestra.run.smithi071.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-15T12:14:32.186 INFO:teuthology.orchestra.run.smithi071.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-15T12:14:32.219 INFO:teuthology.orchestra.run.smithi071.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 619 kB/s | 36 kB 00:00 2024-09-15T12:14:32.245 INFO:teuthology.orchestra.run.smithi071.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2024-09-15T12:14:32.270 INFO:teuthology.orchestra.run.smithi071.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 806 kB/s | 20 kB 00:00 2024-09-15T12:14:32.295 INFO:teuthology.orchestra.run.smithi071.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-15T12:14:39.386 INFO:teuthology.orchestra.run.smithi071.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 7.2 MB/s | 70 MB 00:09 2024-09-15T12:14:39.390 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:14:39.391 INFO:teuthology.orchestra.run.smithi071.stdout:Total 7.2 MB/s | 84 MB 00:11 2024-09-15T12:14:39.543 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:14:39.586 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:14:39.586 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:14:40.380 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:14:40.380 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:14:42.062 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:14:42.139 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-15T12:14:42.171 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-15T12:14:42.198 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-15T12:14:42.271 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-15T12:14:42.323 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-15T12:14:42.364 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-15T12:14:42.456 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-15T12:14:42.550 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-15T12:14:42.591 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-15T12:14:42.626 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-15T12:14:42.656 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-15T12:14:42.690 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-15T12:14:42.732 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-15T12:14:42.773 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-15T12:14:42.824 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-15T12:14:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-15T12:14:42.908 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-15T12:14:42.939 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-15T12:14:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-15T12:14:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-15T12:14:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-15T12:14:43.283 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-15T12:14:43.322 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-15T12:14:43.380 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-15T12:14:43.436 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-15T12:14:43.630 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-15T12:14:43.685 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-15T12:14:43.763 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-15T12:14:43.860 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-15T12:14:43.913 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-15T12:14:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-15T12:14:44.236 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-15T12:14:44.261 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-15T12:14:44.286 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-15T12:14:44.287 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:14:44.287 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T12:14:44.287 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T12:14:44.287 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T12:14:44.287 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:14:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-15T12:14:54.854 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-15T12:14:54.855 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:14:54.855 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T12:14:54.855 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T12:14:54.855 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T12:14:54.855 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:14:55.402 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-15T12:14:55.426 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-15T12:14:55.426 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:14:55.426 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T12:14:55.426 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T12:14:55.426 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T12:14:55.426 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:14:55.661 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-15T12:14:55.685 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-15T12:14:55.685 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:14:55.685 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T12:14:55.685 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T12:14:55.686 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T12:14:55.686 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:14:55.766 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-15T12:15:02.433 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-15T12:15:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-15T12:15:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-15T12:15:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-15T12:15:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-15T12:15:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-15T12:15:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-15T12:15:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-15T12:15:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-15T12:15:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-15T12:15:02.434 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-15T12:15:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-15T12:15:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-15T12:15:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-15T12:15:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-15T12:15:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-15T12:15:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-15T12:15:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-15T12:15:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-15T12:15:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-15T12:15:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-15T12:15:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-15T12:15:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-15T12:15:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-15T12:15:02.435 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-15T12:15:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-15T12:15:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-15T12:15:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-15T12:15:02.436 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-15T12:15:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-15T12:15:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-15T12:15:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-15T12:15:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-15T12:15:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-15T12:15:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-15T12:15:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-15T12:15:02.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-15T12:15:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-15T12:15:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:03.580 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:15:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:15:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T12:15:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T12:15:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T12:15:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T12:15:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T12:15:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T12:15:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T12:15:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T12:15:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T12:15:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T12:15:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T12:15:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T12:15:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T12:15:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T12:15:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T12:15:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T12:15:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T12:15:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T12:15:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T12:15:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T12:15:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T12:15:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T12:15:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T12:15:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T12:15:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T12:15:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T12:15:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T12:15:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T12:15:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T12:15:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T12:15:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T12:15:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:03.583 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:03.917 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-base 2024-09-15T12:15:04.478 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:31 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:04.570 INFO:teuthology.orchestra.run.smithi071.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:15:04.611 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:04.612 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-15T12:15:04.612 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:04.685 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install cephadm 2024-09-15T12:15:05.242 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:32 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:05.381 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:05.381 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:05.382 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-15T12:15:05.382 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:05.382 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:15:05.382 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-15T12:15:05.382 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:05.382 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:15:05.382 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:05.382 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-15T12:15:05.382 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:05.382 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 785 k 2024-09-15T12:15:05.382 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 791 k 2024-09-15T12:15:05.382 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:15:06.462 INFO:teuthology.orchestra.run.smithi071.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 723 kB/s | 785 kB 00:01 2024-09-15T12:15:06.462 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:06.462 INFO:teuthology.orchestra.run.smithi071.stdout:Total 722 kB/s | 785 kB 00:01 2024-09-15T12:15:06.463 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:15:06.468 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:15:06.468 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:15:06.475 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:15:06.475 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:15:06.554 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:15:07.015 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:15:07.132 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:15:07.481 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:15:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:15:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:07.762 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:15:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:15:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:07.762 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:07.991 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-immutable-object-cache 2024-09-15T12:15:08.570 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:35 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:08.708 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:08.709 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:08.709 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-15T12:15:08.709 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:08.709 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:15:08.710 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-15T12:15:08.710 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:08.710 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:15:08.710 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:08.710 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-15T12:15:08.710 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:08.710 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 158 k 2024-09-15T12:15:08.710 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 644 k 2024-09-15T12:15:08.710 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:15:09.075 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 433 kB/s | 158 kB 00:00 2024-09-15T12:15:09.076 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:09.076 INFO:teuthology.orchestra.run.smithi071.stdout:Total 431 kB/s | 158 kB 00:00 2024-09-15T12:15:09.076 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:15:09.086 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:15:09.086 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:15:09.142 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:15:09.143 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:15:09.289 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:15:09.352 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:15:09.376 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:15:09.376 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:15:09.376 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T12:15:09.376 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:15:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:10.370 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:15:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:10.370 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:10.595 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr 2024-09-15T12:15:11.163 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:38 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:11.256 INFO:teuthology.orchestra.run.smithi071.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:15:11.300 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:11.301 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-15T12:15:11.301 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:11.375 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-dashboard 2024-09-15T12:15:11.940 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:38 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:12.073 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:12.080 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:12.080 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-15T12:15:12.080 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:12.080 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:15:12.080 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-15T12:15:12.080 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-15T12:15:12.080 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T12:15:12.080 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-15T12:15:12.080 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-15T12:15:12.080 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T12:15:12.080 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T12:15:12.081 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T12:15:12.081 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T12:15:12.081 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T12:15:12.081 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T12:15:12.081 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T12:15:12.081 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:12.081 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:15:12.081 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:12.081 INFO:teuthology.orchestra.run.smithi071.stdout:Install 11 Packages 2024-09-15T12:15:12.082 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:12.083 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 18 M 2024-09-15T12:15:12.083 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 155 M 2024-09-15T12:15:12.083 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:15:12.694 INFO:teuthology.orchestra.run.smithi071.stdout:(1/11): ceph-prometheus-alerts-19.3.0-4879.g81f 52 kB/s | 16 kB 00:00 2024-09-15T12:15:12.723 INFO:teuthology.orchestra.run.smithi071.stdout:(2/11): ceph-grafana-dashboards-19.3.0-4879.g81 100 kB/s | 34 kB 00:00 2024-09-15T12:15:12.853 INFO:teuthology.orchestra.run.smithi071.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.7 MB/s | 269 kB 00:00 2024-09-15T12:15:12.911 INFO:teuthology.orchestra.run.smithi071.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-15T12:15:12.937 INFO:teuthology.orchestra.run.smithi071.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-15T12:15:13.012 INFO:teuthology.orchestra.run.smithi071.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-15T12:15:13.037 INFO:teuthology.orchestra.run.smithi071.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-15T12:15:13.063 INFO:teuthology.orchestra.run.smithi071.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-15T12:15:13.092 INFO:teuthology.orchestra.run.smithi071.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 7.3 MB/s | 188 kB 00:00 2024-09-15T12:15:13.138 INFO:teuthology.orchestra.run.smithi071.stdout:(10/11): protobuf-compiler-3.14.0-13.el9.x86_64 2.0 MB/s | 863 kB 00:00 2024-09-15T12:15:15.530 INFO:teuthology.orchestra.run.smithi071.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 4.5 MB/s | 14 MB 00:03 2024-09-15T12:15:15.534 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:15.534 INFO:teuthology.orchestra.run.smithi071.stdout:Total 5.3 MB/s | 18 MB 00:03 2024-09-15T12:15:15.567 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:15:15.588 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:15:15.588 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:15:15.840 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:15:15.840 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:15:16.399 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:15:16.469 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-15T12:15:16.509 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-15T12:15:16.592 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-15T12:15:16.725 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-15T12:15:16.777 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-15T12:15:16.861 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-15T12:15:16.905 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-15T12:15:16.933 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-15T12:15:16.965 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-15T12:15:20.138 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-15T12:15:20.203 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-15T12:15:22.208 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-15T12:15:22.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-15T12:15:22.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-15T12:15:22.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-15T12:15:22.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-15T12:15:22.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-15T12:15:22.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-15T12:15:22.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-15T12:15:22.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-15T12:15:22.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-15T12:15:22.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-15T12:15:22.517 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-15T12:15:22.518 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:22.518 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:15:22.518 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T12:15:22.518 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:15:22.518 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:15:22.518 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:15:22.518 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T12:15:22.518 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T12:15:22.518 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T12:15:22.518 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T12:15:22.518 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T12:15:22.518 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T12:15:22.519 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T12:15:22.519 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:22.519 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:22.780 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-15T12:15:23.343 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:50 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:23.476 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:23.477 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-15T12:15:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-15T12:15:23.478 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-15T12:15:23.478 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:15:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-15T12:15:23.478 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-15T12:15:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T12:15:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T12:15:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T12:15:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T12:15:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T12:15:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T12:15:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T12:15:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T12:15:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T12:15:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T12:15:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T12:15:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:23.479 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:15:23.479 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-15T12:15:23.479 INFO:teuthology.orchestra.run.smithi071.stdout:Install 12 Packages 2024-09-15T12:15:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:23.480 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 38 M 2024-09-15T12:15:23.480 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 212 M 2024-09-15T12:15:23.480 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:15:24.060 INFO:teuthology.orchestra.run.smithi071.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-15T12:15:24.101 INFO:teuthology.orchestra.run.smithi071.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-15T12:15:24.202 INFO:teuthology.orchestra.run.smithi071.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 231 kB/s | 33 kB 00:00 2024-09-15T12:15:24.277 INFO:teuthology.orchestra.run.smithi071.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 243 kB/s | 18 kB 00:00 2024-09-15T12:15:24.336 INFO:teuthology.orchestra.run.smithi071.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2024-09-15T12:15:24.361 INFO:teuthology.orchestra.run.smithi071.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-15T12:15:24.478 INFO:teuthology.orchestra.run.smithi071.stdout:(7/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 35 MB/s | 4.9 MB 00:00 2024-09-15T12:15:24.503 INFO:teuthology.orchestra.run.smithi071.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-15T12:15:24.603 INFO:teuthology.orchestra.run.smithi071.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 41 MB/s | 5.1 MB 00:00 2024-09-15T12:15:24.628 INFO:teuthology.orchestra.run.smithi071.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.0 MB/s | 250 kB 00:00 2024-09-15T12:15:24.962 INFO:teuthology.orchestra.run.smithi071.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-09-15T12:15:25.062 INFO:teuthology.orchestra.run.smithi071.stdout:(12/12): ceph-mgr-diskprediction-local-19.3.0-4 6.5 MB/s | 7.4 MB 00:01 2024-09-15T12:15:25.063 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:25.063 INFO:teuthology.orchestra.run.smithi071.stdout:Total 24 MB/s | 38 MB 00:01 2024-09-15T12:15:25.419 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:15:25.446 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:15:25.446 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:15:25.885 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:15:25.885 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:15:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:15:26.749 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-15T12:15:26.786 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-15T12:15:26.894 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-15T12:15:26.937 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-15T12:15:27.120 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-15T12:15:27.152 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-15T12:15:27.228 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-15T12:15:27.883 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-15T12:15:28.006 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-15T12:15:29.233 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-15T12:15:30.278 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-15T12:15:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-15T12:15:32.921 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-15T12:15:32.921 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-15T12:15:32.921 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-15T12:15:32.921 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-15T12:15:32.921 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-15T12:15:32.921 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-15T12:15:32.921 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-15T12:15:32.921 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-15T12:15:32.921 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-15T12:15:32.921 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-15T12:15:32.922 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-15T12:15:32.922 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-15T12:15:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-15T12:15:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:33.328 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:15:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:15:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T12:15:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T12:15:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T12:15:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T12:15:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T12:15:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T12:15:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T12:15:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T12:15:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T12:15:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T12:15:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T12:15:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:33.329 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:33.768 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-rook 2024-09-15T12:15:34.348 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:01 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:34.483 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:34.483 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-15T12:15:34.483 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:34.483 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:15:34.483 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-15T12:15:34.483 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-15T12:15:34.483 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T12:15:34.483 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T12:15:34.483 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T12:15:34.483 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T12:15:34.483 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T12:15:34.483 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T12:15:34.484 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T12:15:34.484 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T12:15:34.484 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T12:15:34.484 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T12:15:34.484 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T12:15:34.484 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T12:15:34.484 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:34.484 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:15:34.484 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:34.484 INFO:teuthology.orchestra.run.smithi071.stdout:Install 13 Packages 2024-09-15T12:15:34.484 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:34.485 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 2.2 M 2024-09-15T12:15:34.485 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 26 M 2024-09-15T12:15:34.485 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:15:35.083 INFO:teuthology.orchestra.run.smithi071.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 280 kB/s | 26 kB 00:00 2024-09-15T12:15:35.109 INFO:teuthology.orchestra.run.smithi071.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 164 kB/s | 19 kB 00:00 2024-09-15T12:15:35.250 INFO:teuthology.orchestra.run.smithi071.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-15T12:15:35.276 INFO:teuthology.orchestra.run.smithi071.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.3 MB/s | 222 kB 00:00 2024-09-15T12:15:35.326 INFO:teuthology.orchestra.run.smithi071.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-15T12:15:35.368 INFO:teuthology.orchestra.run.smithi071.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 777 kB/s | 32 kB 00:00 2024-09-15T12:15:35.393 INFO:teuthology.orchestra.run.smithi071.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.9 MB/s | 279 kB 00:00 2024-09-15T12:15:35.418 INFO:teuthology.orchestra.run.smithi071.stdout:(8/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 115 kB/s | 49 kB 00:00 2024-09-15T12:15:35.452 INFO:teuthology.orchestra.run.smithi071.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 168 kB/s | 14 kB 00:00 2024-09-15T12:15:35.519 INFO:teuthology.orchestra.run.smithi071.stdout:(10/13): python3-kubernetes-26.1.0-2.el9.noarch 11 MB/s | 1.0 MB 00:00 2024-09-15T12:15:35.544 INFO:teuthology.orchestra.run.smithi071.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.4 MB/s | 220 kB 00:00 2024-09-15T12:15:35.569 INFO:teuthology.orchestra.run.smithi071.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 513 kB/s | 59 kB 00:00 2024-09-15T12:15:35.594 INFO:teuthology.orchestra.run.smithi071.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-09-15T12:15:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:35.600 INFO:teuthology.orchestra.run.smithi071.stdout:Total 2.0 MB/s | 2.2 MB 00:01 2024-09-15T12:15:35.665 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:15:35.684 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:15:35.684 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:15:35.768 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:15:35.772 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:15:36.278 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:15:36.458 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-15T12:15:36.512 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-15T12:15:36.568 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-15T12:15:36.622 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-15T12:15:36.663 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-15T12:15:36.765 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-15T12:15:36.874 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-15T12:15:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-15T12:15:37.629 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-15T12:15:37.678 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-15T12:15:37.712 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-15T12:15:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-15T12:15:37.782 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-15T12:15:38.557 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-15T12:15:38.558 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-15T12:15:38.558 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-15T12:15:38.558 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-15T12:15:38.558 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-15T12:15:38.558 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-15T12:15:38.558 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-15T12:15:38.558 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-15T12:15:38.558 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-15T12:15:38.558 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-15T12:15:38.558 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-15T12:15:38.559 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-15T12:15:38.559 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-15T12:15:38.910 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-15T12:15:38.910 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:38.910 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:15:38.910 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:15:38.910 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T12:15:38.910 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T12:15:38.910 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T12:15:38.910 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T12:15:38.911 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T12:15:38.911 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T12:15:38.911 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T12:15:38.911 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T12:15:38.911 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T12:15:38.911 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T12:15:38.911 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T12:15:38.911 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T12:15:38.911 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:38.911 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:39.174 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-cephadm 2024-09-15T12:15:39.738 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:06 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:39.871 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:39.871 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:39.871 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-15T12:15:39.871 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:39.872 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:15:39.872 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-15T12:15:39.872 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-15T12:15:39.872 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T12:15:39.872 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T12:15:39.872 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T12:15:39.872 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T12:15:39.872 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T12:15:39.872 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:39.872 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:15:39.872 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:39.872 INFO:teuthology.orchestra.run.smithi071.stdout:Install 6 Packages 2024-09-15T12:15:39.872 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:39.873 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 7.0 M 2024-09-15T12:15:39.873 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 33 M 2024-09-15T12:15:39.873 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:15:40.137 INFO:teuthology.orchestra.run.smithi071.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-15T12:15:40.187 INFO:teuthology.orchestra.run.smithi071.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-15T12:15:40.204 INFO:teuthology.orchestra.run.smithi071.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 3.4 MB/s | 58 kB 00:00 2024-09-15T12:15:40.233 INFO:teuthology.orchestra.run.smithi071.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-15T12:15:40.321 INFO:teuthology.orchestra.run.smithi071.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-15T12:15:40.496 INFO:teuthology.orchestra.run.smithi071.stdout:(6/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 288 kB/s | 154 kB 00:00 2024-09-15T12:15:40.498 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:40.498 INFO:teuthology.orchestra.run.smithi071.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-15T12:15:40.568 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:15:40.579 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:15:40.580 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:15:40.678 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:15:40.679 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:15:40.988 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:15:41.161 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-15T12:15:41.215 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-15T12:15:41.731 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-15T12:15:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-15T12:15:41.901 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-15T12:15:41.927 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-15T12:15:42.882 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-15T12:15:42.882 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-15T12:15:42.882 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-15T12:15:42.882 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-15T12:15:42.882 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-15T12:15:42.882 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-15T12:15:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-15T12:15:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:43.155 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:15:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:15:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T12:15:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T12:15:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T12:15:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T12:15:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T12:15:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:43.155 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:43.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-fuse 2024-09-15T12:15:43.988 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:10 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:44.120 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:44.120 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:44.120 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-15T12:15:44.121 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:44.121 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:15:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-15T12:15:44.121 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-15T12:15:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T12:15:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:44.121 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:15:44.121 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:44.121 INFO:teuthology.orchestra.run.smithi071.stdout:Install 2 Packages 2024-09-15T12:15:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:44.122 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 964 k 2024-09-15T12:15:44.122 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 4.1 M 2024-09-15T12:15:44.122 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:15:44.440 INFO:teuthology.orchestra.run.smithi071.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 537 kB/s | 80 kB 00:00 2024-09-15T12:15:45.098 INFO:teuthology.orchestra.run.smithi071.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 1.1 MB/s | 884 kB 00:00 2024-09-15T12:15:45.099 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:45.099 INFO:teuthology.orchestra.run.smithi071.stdout:Total 986 kB/s | 964 kB 00:00 2024-09-15T12:15:45.113 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:15:45.138 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:15:45.138 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:15:45.222 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:15:45.222 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:15:45.415 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:15:45.550 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-15T12:15:45.622 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-15T12:15:46.363 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-15T12:15:46.363 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-15T12:15:46.641 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-15T12:15:46.641 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:46.641 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:15:46.641 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-15T12:15:46.641 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:46.641 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:46.919 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-volume 2024-09-15T12:15:47.494 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:14 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:47.629 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:47.630 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:47.630 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-15T12:15:47.631 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:47.631 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:15:47.631 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-15T12:15:47.631 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:47.631 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:15:47.631 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:47.631 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-15T12:15:47.631 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:47.631 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 285 k 2024-09-15T12:15:47.631 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 1.3 M 2024-09-15T12:15:47.632 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:15:48.144 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 557 kB/s | 285 kB 00:00 2024-09-15T12:15:48.144 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:48.145 INFO:teuthology.orchestra.run.smithi071.stdout:Total 555 kB/s | 285 kB 00:00 2024-09-15T12:15:48.145 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:15:48.153 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:15:48.153 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:15:48.184 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:15:48.184 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:15:48.406 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:15:48.479 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:15:48.495 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:15:48.495 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:15:48.495 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T12:15:48.495 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:49.529 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:15:49.529 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:49.529 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:15:49.529 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:15:49.529 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:49.529 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:49.844 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librados-devel 2024-09-15T12:15:50.428 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:17 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:50.565 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:50.566 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:50.566 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-15T12:15:50.566 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:50.566 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:15:50.566 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-15T12:15:50.566 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:50.567 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:15:50.567 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:50.567 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-15T12:15:50.567 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:50.567 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 125 k 2024-09-15T12:15:50.567 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 445 k 2024-09-15T12:15:50.567 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:15:50.981 INFO:teuthology.orchestra.run.smithi071.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 301 kB/s | 125 kB 00:00 2024-09-15T12:15:50.982 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:50.982 INFO:teuthology.orchestra.run.smithi071.stdout:Total 300 kB/s | 125 kB 00:00 2024-09-15T12:15:50.982 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:15:50.988 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:15:50.988 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:15:51.056 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:15:51.056 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:15:51.216 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:15:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:15:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:15:52.049 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:15:52.049 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:52.050 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:15:52.050 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:52.050 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:52.050 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:52.266 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install libcephfs2 2024-09-15T12:15:52.846 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:19 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:52.936 INFO:teuthology.orchestra.run.smithi071.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:15:52.981 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:52.982 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-15T12:15:52.982 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:53.052 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install libcephfs-devel 2024-09-15T12:15:53.621 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:20 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:53.755 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:53.756 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:53.756 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-15T12:15:53.756 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:53.756 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:15:53.757 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-15T12:15:53.757 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:53.757 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:15:53.757 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:15:53.757 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-15T12:15:53.757 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:53.757 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 32 k 2024-09-15T12:15:53.757 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 142 k 2024-09-15T12:15:53.757 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:15:54.093 INFO:teuthology.orchestra.run.smithi071.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 95 kB/s | 32 kB 00:00 2024-09-15T12:15:54.093 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:54.093 INFO:teuthology.orchestra.run.smithi071.stdout:Total 94 kB/s | 32 kB 00:00 2024-09-15T12:15:54.093 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:15:54.097 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:15:54.097 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:15:54.124 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:15:54.125 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:15:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:15:54.331 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:15:54.715 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:15:54.952 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:15:54.952 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:54.952 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:15:54.952 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:54.952 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:15:54.952 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:55.143 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librados2 2024-09-15T12:15:55.706 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:22 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:55.796 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:15:55.840 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:55.841 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-15T12:15:55.841 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:55.913 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librbd1 2024-09-15T12:15:56.467 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:23 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:56.558 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:15:56.601 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:56.602 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-15T12:15:56.602 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:56.671 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rados 2024-09-15T12:15:57.234 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:24 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:57.324 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:15:57.367 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:57.368 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-15T12:15:57.368 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:57.439 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rgw 2024-09-15T12:15:58.001 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:24 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:58.091 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:15:58.134 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:58.134 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-15T12:15:58.135 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:58.206 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-cephfs 2024-09-15T12:15:58.770 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:25 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:58.862 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:15:58.905 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:58.906 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-15T12:15:58.906 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:58.981 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rbd 2024-09-15T12:15:59.544 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:26 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:15:59.635 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:15:59.678 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:15:59.679 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-15T12:15:59.679 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:15:59.769 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-fuse 2024-09-15T12:16:00.333 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:27 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:16:00.467 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:16:00.468 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:16:00.468 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-09-15T12:16:00.468 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:16:00.469 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:16:00.469 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-15T12:16:00.469 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:00.469 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:16:00.469 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:16:00.469 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-15T12:16:00.469 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:00.469 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 91 k 2024-09-15T12:16:00.469 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 321 k 2024-09-15T12:16:00.469 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:16:00.879 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 222 kB/s | 91 kB 00:00 2024-09-15T12:16:00.879 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:00.879 INFO:teuthology.orchestra.run.smithi071.stdout:Total 221 kB/s | 91 kB 00:00 2024-09-15T12:16:00.879 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:16:00.888 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:16:00.889 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:16:00.952 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:16:00.953 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:16:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:16:01.201 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:01.584 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:01.855 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:01.856 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:01.856 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:16:01.856 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:01.856 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:01.856 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:16:02.120 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-mirror 2024-09-15T12:16:02.691 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:29 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:16:02.826 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:16:02.827 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:16:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-15T12:16:02.827 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:16:02.827 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:16:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-15T12:16:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:02.827 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:16:02.827 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:16:02.827 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-15T12:16:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:02.827 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 3.5 M 2024-09-15T12:16:02.827 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 30 M 2024-09-15T12:16:02.828 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:16:11.272 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 425 kB/s | 3.5 MB 00:08 2024-09-15T12:16:11.273 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:11.273 INFO:teuthology.orchestra.run.smithi071.stdout:Total 425 kB/s | 3.5 MB 00:08 2024-09-15T12:16:11.273 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:16:11.286 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:16:11.287 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:16:11.373 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:16:11.374 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:16:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:16:12.039 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:12.064 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:12.064 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:16:12.065 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T12:16:12.065 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T12:16:12.065 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T12:16:12.065 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:13.324 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:13.325 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:13.325 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:16:13.325 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:13.325 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:13.325 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:16:13.585 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-nbd 2024-09-15T12:16:14.161 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:41 ago on Sun 15 Sep 2024 12:13:33 PM UTC. 2024-09-15T12:16:14.296 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-15T12:16:14.297 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:16:14.297 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-09-15T12:16:14.297 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:16:14.297 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-15T12:16:14.297 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-15T12:16:14.297 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:14.297 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-15T12:16:14.298 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-15T12:16:14.298 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-15T12:16:14.298 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:14.298 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 177 k 2024-09-15T12:16:14.298 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 685 k 2024-09-15T12:16:14.298 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-15T12:16:14.916 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 286 kB/s | 177 kB 00:00 2024-09-15T12:16:14.917 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:14.917 INFO:teuthology.orchestra.run.smithi071.stdout:Total 285 kB/s | 177 kB 00:00 2024-09-15T12:16:14.917 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-15T12:16:14.927 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-15T12:16:14.927 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-15T12:16:14.996 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-15T12:16:14.996 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-15T12:16:15.180 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-15T12:16:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:15.703 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:15.969 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:16:15.969 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:15.969 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-15T12:16:15.970 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:15.970 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:15.970 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-15T12:16:16.254 DEBUG:teuthology.parallel:result is None 2024-09-15T12:16:16.255 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:16:16.398 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T12:16:16.421 INFO:teuthology.orchestra.run.smithi071.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-15T12:16:16.421 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-15T12:16:16.422 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-15T12:16:16.423 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T12:16:16.423 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:16.424 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T12:16:16.487 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T12:16:16.487 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:16.487 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T12:16:16.552 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T12:16:16.617 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T12:16:16.617 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:16.617 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T12:16:16.682 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T12:16:16.747 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T12:16:16.747 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:16.748 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T12:16:16.813 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T12:16:16.878 INFO:teuthology.run_tasks:Running task ceph... 2024-09-15T12:16:16.961 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-15T12:16:16.961 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /var/log/ceph 2024-09-15T12:16:17.017 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-15T12:16:17.017 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T12:16:17.041 INFO:tasks.ceph:Creating extra log directories... 2024-09-15T12:16:17.042 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T12:16:17.113 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-15T12:16:17.113 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-15T12:16:17.113 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905501', 'branch': 'wip-matanb-crimson-testing-59543', 'description': 'crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rbd_api_tests_old_format}', 'email': None, 'first_in_suite': False, 'job_id': '7905501', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 1236, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi071.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCVy7BZDUKSVT3fqfqw5auzm2SfqLMpO3jqK2sKc6Zl+uL9qF9nYAikDadYCz10OYE0M31UCN6wx5FzeFZ2/WmM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rbd/crimson/test_crimson_librbd.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_11:59:21', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-15T12:16:17.113 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T12:16:17.161 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T12:16:17.225 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:17.225 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T12:16:17.281 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T12:16:17.282 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-09-15T12:16:17.337 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T12:16:17.337 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:16:17.337 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-15T12:16:17.337 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:16:17.337 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:16:17.337 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-15 12:16:12.326132777 +0000 2024-09-15T12:16:17.337 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-15 12:12:48.491350577 +0000 2024-09-15T12:16:17.338 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-15 12:12:48.491350577 +0000 2024-09-15T12:16:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-15 12:12:48.491350577 +0000 2024-09-15T12:16:17.338 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T12:16:17.400 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-15T12:16:17.400 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-15T12:16:17.400 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.00020303 s, 2.5 MB/s 2024-09-15T12:16:17.401 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T12:16:17.458 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-09-15T12:16:17.514 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T12:16:17.514 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:16:17.514 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-15T12:16:17.514 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:16:17.514 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:16:17.514 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-15 12:16:12.326132777 +0000 2024-09-15T12:16:17.514 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-15 12:12:48.891342866 +0000 2024-09-15T12:16:17.515 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-15 12:12:48.891342866 +0000 2024-09-15T12:16:17.515 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-15 12:12:48.891342866 +0000 2024-09-15T12:16:17.515 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T12:16:17.577 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-15T12:16:17.578 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-15T12:16:17.578 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000315075 s, 1.6 MB/s 2024-09-15T12:16:17.579 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T12:16:17.635 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-09-15T12:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T12:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-15T12:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-15 12:16:12.327132759 +0000 2024-09-15T12:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-15 12:12:49.248335984 +0000 2024-09-15T12:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-15 12:12:49.248335984 +0000 2024-09-15T12:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-15 12:12:49.248335984 +0000 2024-09-15T12:16:17.691 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T12:16:17.755 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-15T12:16:17.755 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-15T12:16:17.755 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000211829 s, 2.4 MB/s 2024-09-15T12:16:17.756 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T12:16:17.812 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-09-15T12:16:17.867 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T12:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-15T12:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-15 12:16:12.327132759 +0000 2024-09-15T12:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-15 12:12:49.621328794 +0000 2024-09-15T12:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-15 12:12:49.621328794 +0000 2024-09-15T12:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-15 12:12:49.621328794 +0000 2024-09-15T12:16:17.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T12:16:17.930 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-15T12:16:17.930 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-15T12:16:17.931 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000165515 s, 3.1 MB/s 2024-09-15T12:16:17.931 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T12:16:17.988 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-15T12:16:17.988 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-15T12:16:17.988 INFO:tasks.ceph:Generating config... 2024-09-15T12:16:17.990 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-15T12:16:17.991 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-15T12:16:17.991 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-15T12:16:17.991 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-15T12:16:17.991 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-15T12:16:17.991 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-15T12:16:17.991 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-15T12:16:17.992 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-15T12:16:17.992 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-15T12:16:17.992 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-15T12:16:17.992 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-15T12:16:17.993 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-15T12:16:17.993 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-15T12:16:17.993 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-15T12:16:17.993 INFO:tasks.ceph:[osd] osd objectstore = seastore 2024-09-15T12:16:17.993 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-15T12:16:17.993 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-15T12:16:17.994 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-15T12:16:17.994 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-15T12:16:17.994 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-15T12:16:17.994 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-15T12:16:17.994 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-15T12:16:17.994 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-15T12:16:17.995 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-15T12:16:17.995 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-15T12:16:17.995 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-15T12:16:17.995 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-1 2024-09-15T12:16:17.995 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 2-3 2024-09-15T12:16:17.995 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 4-5 2024-09-15T12:16:17.996 INFO:tasks.ceph:Setting up mon.a... 2024-09-15T12:16:17.996 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-15T12:16:18.096 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.keyring 2024-09-15T12:16:18.099 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-15T12:16:18.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T12:16:18.175 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.71')] 2024-09-15T12:16:18.176 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.71', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}} 2024-09-15T12:16:18.176 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:18.176 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T12:16:18.231 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.71 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:16:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:18.320+0000 7fc0d34cdf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:18.320+0000 7fc0d34cdf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:18.320+0000 7fc0d34cdf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:18.323 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:16:18.323 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: generated fsid 15740f92-12c8-45c5-92c7-38ec03331077 2024-09-15T12:16:18.323 INFO:teuthology.orchestra.run.smithi071.stdout:setting min_mon_release = quincy 2024-09-15T12:16:18.323 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 0 2024-09-15T12:16:18.323 INFO:teuthology.orchestra.run.smithi071.stdout:fsid 15740f92-12c8-45c5-92c7-38ec03331077 2024-09-15T12:16:18.323 INFO:teuthology.orchestra.run.smithi071.stdout:last_changed 2024-09-15T12:16:18.321918+0000 2024-09-15T12:16:18.323 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-15T12:16:18.321918+0000 2024-09-15T12:16:18.323 INFO:teuthology.orchestra.run.smithi071.stdout:min_mon_release 17 (quincy) 2024-09-15T12:16:18.323 INFO:teuthology.orchestra.run.smithi071.stdout:election_strategy: 1 2024-09-15T12:16:18.324 INFO:teuthology.orchestra.run.smithi071.stdout:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-15T12:16:18.324 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-15T12:16:18.325 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T12:16:18.340 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 15740f92-12c8-45c5-92c7-38ec03331077... 2024-09-15T12:16:18.340 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T12:16:18.423 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2024-09-15T12:16:18.423 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2024-09-15T12:16:18.423 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T12:16:18.424 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2024-09-15T12:16:18.424 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.424 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2024-09-15T12:16:18.424 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.424 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2024-09-15T12:16:18.424 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.424 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2024-09-15T12:16:18.424 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2024-09-15T12:16:18.424 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.424 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2024-09-15T12:16:18.424 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2024-09-15T12:16:18.424 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.424 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T12:16:18.425 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2024-09-15T12:16:18.425 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.425 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T12:16:18.425 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T12:16:18.425 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.425 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2024-09-15T12:16:18.425 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.425 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2024-09-15T12:16:18.425 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2024-09-15T12:16:18.425 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2024-09-15T12:16:18.425 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2024-09-15T12:16:18.425 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2024-09-15T12:16:18.426 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2024-09-15T12:16:18.426 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2024-09-15T12:16:18.426 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T12:16:18.426 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T12:16:18.426 INFO:teuthology.orchestra.run.smithi071.stdout: mon_allow_pool_size_one = true 2024-09-15T12:16:18.426 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.426 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T12:16:18.426 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.426 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2024-09-15T12:16:18.426 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.426 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2024-09-15T12:16:18.426 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.426 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2024-09-15T12:16:18.426 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2024-09-15T12:16:18.427 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2024-09-15T12:16:18.427 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = 172.21.15.71 2024-09-15T12:16:18.427 INFO:teuthology.orchestra.run.smithi071.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-15T12:16:18.427 INFO:teuthology.orchestra.run.smithi071.stdout: ms client mode = crc 2024-09-15T12:16:18.427 INFO:teuthology.orchestra.run.smithi071.stdout: ms cluster mode = crc 2024-09-15T12:16:18.427 INFO:teuthology.orchestra.run.smithi071.stdout: ms mon client mode = crc 2024-09-15T12:16:18.427 INFO:teuthology.orchestra.run.smithi071.stdout: ms mon cluster mode = crc 2024-09-15T12:16:18.427 INFO:teuthology.orchestra.run.smithi071.stdout: ms mon service mode = crc 2024-09-15T12:16:18.427 INFO:teuthology.orchestra.run.smithi071.stdout: ms service mode = crc 2024-09-15T12:16:18.427 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 15740f92-12c8-45c5-92c7-38ec03331077 2024-09-15T12:16:18.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.427 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2024-09-15T12:16:18.427 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2024-09-15T12:16:18.428 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.428 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2024-09-15T12:16:18.428 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2024-09-15T12:16:18.428 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock profile = high_recovery_ops 2024-09-15T12:16:18.428 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.428 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2024-09-15T12:16:18.428 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2024-09-15T12:16:18.428 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.428 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2024-09-15T12:16:18.428 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2024-09-15T12:16:18.428 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2024-09-15T12:16:18.428 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug trim objects = true 2024-09-15T12:16:18.428 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.429 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2024-09-15T12:16:18.429 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2024-09-15T12:16:18.429 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.429 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2024-09-15T12:16:18.429 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.429 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2024-09-15T12:16:18.429 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.429 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2024-09-15T12:16:18.429 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.429 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2024-09-15T12:16:18.429 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2024-09-15T12:16:18.429 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.429 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2024-09-15T12:16:18.429 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2024-09-15T12:16:18.429 INFO:teuthology.orchestra.run.smithi071.stdout: debug monc = 20 2024-09-15T12:16:18.430 INFO:teuthology.orchestra.run.smithi071.stdout: crimson alien thread cpu cores = 6-7 2024-09-15T12:16:18.430 INFO:teuthology.orchestra.run.smithi071.stdout: crimson osd obc lru size = 10 2024-09-15T12:16:18.430 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-09-15T12:16:18.430 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2024-09-15T12:16:18.430 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = seastore 2024-09-15T12:16:18.430 INFO:teuthology.orchestra.run.smithi071.stdout: osd shutdown pgref assert = True 2024-09-15T12:16:18.430 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.430 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2024-09-15T12:16:18.430 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-09-15T12:16:18.430 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2024-09-15T12:16:18.430 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-09-15T12:16:18.430 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-09-15T12:16:18.430 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-09-15T12:16:18.430 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-09-15T12:16:18.431 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2024-09-15T12:16:18.431 INFO:teuthology.orchestra.run.smithi071.stdout: mgr stats period = 30 2024-09-15T12:16:18.431 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.431 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2024-09-15T12:16:18.431 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-09-15T12:16:18.431 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-09-15T12:16:18.431 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2024-09-15T12:16:18.431 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-09-15T12:16:18.431 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2024-09-15T12:16:18.431 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2024-09-15T12:16:18.431 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-09-15T12:16:18.431 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2024-09-15T12:16:18.431 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2024-09-15T12:16:18.431 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-09-15T12:16:18.432 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.432 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T12:16:18.432 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T12:16:18.432 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T12:16:18.432 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.432 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T12:16:18.432 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T12:16:18.432 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T12:16:18.432 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.433 INFO:teuthology.orchestra.run.smithi071.stdout: # 1m isn't quite enough 2024-09-15T12:16:18.433 INFO:teuthology.orchestra.run.smithi071.stdout: mon_down_mkfs_grace = 2m 2024-09-15T12:16:18.433 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.433 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_filestore_osds = false 2024-09-15T12:16:18.434 INFO:teuthology.orchestra.run.smithi071.stdout: mon min osdmap epochs = 50 2024-09-15T12:16:18.434 INFO:teuthology.orchestra.run.smithi071.stdout: mon osdmap full prune interval = 2 2024-09-15T12:16:18.434 INFO:teuthology.orchestra.run.smithi071.stdout: mon osdmap full prune min = 15 2024-09-15T12:16:18.434 INFO:teuthology.orchestra.run.smithi071.stdout: mon osdmap full prune txsize = 2 2024-09-15T12:16:18.434 INFO:teuthology.orchestra.run.smithi071.stdout: paxos service trim min = 10 2024-09-15T12:16:18.434 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default crimson = True 2024-09-15T12:16:18.434 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:18.434 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2024-09-15T12:16:18.434 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2024-09-15T12:16:18.434 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2024-09-15T12:16:18.434 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2024-09-15T12:16:18.434 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T12:16:18.435 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T12:16:18.435 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2024-09-15T12:16:18.435 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.0] 2024-09-15T12:16:18.435 INFO:teuthology.orchestra.run.smithi071.stdout: crimson seastar cpu cores = 0-1 2024-09-15T12:16:18.435 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.1] 2024-09-15T12:16:18.435 INFO:teuthology.orchestra.run.smithi071.stdout: crimson seastar cpu cores = 2-3 2024-09-15T12:16:18.435 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.2] 2024-09-15T12:16:18.435 INFO:teuthology.orchestra.run.smithi071.stdout: crimson seastar cpu cores = 4-5 2024-09-15T12:16:18.436 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-15T12:16:18.436 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-15T12:16:18.541 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-15T12:16:18.541 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:18.542 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-15T12:16:18.557 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:18.557 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-15T12:16:18.612 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi071.front.sepia.ceph.com 2024-09-15T12:16:18.613 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:18.613 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T12:16:18.613 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T12:16:18.687 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:18.687 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:16:18.742 INFO:tasks.ceph:Setting up mon nodes... 2024-09-15T12:16:18.743 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-15T12:16:18.743 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T12:16:18.842 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T12:16:18.845 INFO:tasks.ceph:Setting up mds nodes... 2024-09-15T12:16:18.845 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-15T12:16:18.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T12:16:18.895 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-15T12:16:18.908 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-15T12:16:18.908 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-15T12:16:18.908 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-15T12:16:18.933 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-15T12:16:18.933 INFO:tasks.ceph:role: osd.0 2024-09-15T12:16:18.933 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-15T12:16:18.933 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T12:16:19.005 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T12:16:19.005 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T12:16:19.005 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T12:16:19.006 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T12:16:19.006 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T12:16:19.006 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-15T12:16:19.006 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T12:16:19.006 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T12:16:19.006 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T12:16:19.006 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T12:16:19.517 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-15T12:16:19.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-15T12:16:19.519 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-15T12:16:19.667 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-15T12:16:19.700 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-15T12:16:19.767 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-15T12:16:19.767 INFO:tasks.ceph:role: osd.1 2024-09-15T12:16:19.768 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-15T12:16:19.768 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T12:16:19.841 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T12:16:19.841 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T12:16:19.841 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T12:16:19.841 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T12:16:19.841 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T12:16:19.841 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-15T12:16:19.841 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T12:16:19.841 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T12:16:19.841 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T12:16:19.841 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T12:16:20.286 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-15T12:16:20.288 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-15T12:16:20.288 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-15T12:16:20.382 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-15T12:16:20.411 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-15T12:16:20.475 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-15T12:16:20.475 INFO:tasks.ceph:role: osd.2 2024-09-15T12:16:20.475 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-15T12:16:20.476 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T12:16:20.548 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T12:16:20.548 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T12:16:20.548 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T12:16:20.548 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T12:16:20.548 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T12:16:20.548 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-15T12:16:20.548 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T12:16:20.548 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T12:16:20.548 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T12:16:20.549 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T12:16:21.035 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-15T12:16:21.037 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-15T12:16:21.037 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-15T12:16:21.192 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-15T12:16:21.221 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:16:21.512 INFO:teuthology.orchestra.run.smithi071.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:16:21.513 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2024-09-15 12:16:21,513 seastar - Reactor backend: linux-aio 2024-09-15T12:16:21.524 INFO:teuthology.orchestra.run.smithi071.stderr:==28210==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:16:21.639 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2024-09-15 12:16:21,638 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-15T12:16:21.639 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2024-09-15 12:16:21,639 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-1 2024-09-15T12:16:21.640 INFO:teuthology.orchestra.run.smithi071.stderr:DEBUG 2024-09-15 12:16:21,639 [shard 0:main] seastar - reactor::drain 2024-09-15T12:16:22.157 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2024-09-15T12:16:22.157 INFO:teuthology.orchestra.run.smithi071.stderr:Suppressions used: 2024-09-15T12:16:22.157 INFO:teuthology.orchestra.run.smithi071.stderr: count bytes template 2024-09-15T12:16:22.157 INFO:teuthology.orchestra.run.smithi071.stderr: 1 8 MallocExtension::Register 2024-09-15T12:16:22.157 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2024-09-15T12:16:22.157 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-15T12:16:22.211 INFO:teuthology.orchestra.run.smithi071.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:16:22.215 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2024-09-15 12:16:22,214 seastar - Reactor backend: linux-aio 2024-09-15T12:16:22.223 INFO:teuthology.orchestra.run.smithi071.stderr:==28208==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:16:22.288 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x1659bc 0x7d446 0x5c03953 0x5c55c8d 0x6038b31 0x5fb8d06 0x5fb8ee0 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:22.288 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:22.504 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xb85346a 0xba3392c 0xba33a5e 0xba33bda 0xba34389 0xb9cef3d 0x9843791 0x9af9f5a 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-15T12:16:22.505 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab79 0x61146f4 0xba3480f 0xba349ab 0xba34b2c 0xba34cc8 0xba3505e 0xba35270 0xb9d20ef 0xb9d2514 0xb9d9f7f 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9e12036 0x9e2237e 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-15T12:16:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:22.729 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10d778 0xdd31a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:22.729 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab9d 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-15T12:16:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:22.862 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab37 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-15T12:16:22.862 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:22.894 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542bf3 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:22.894 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:22.970 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab92 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-15T12:16:22.970 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133d10 0xdd332 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:23.374 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2024-09-15T12:16:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:Suppressions used: 2024-09-15T12:16:24.396 INFO:teuthology.orchestra.run.smithi071.stderr: count bytes template 2024-09-15T12:16:24.397 INFO:teuthology.orchestra.run.smithi071.stderr: 1 8 MallocExtension::Register 2024-09-15T12:16:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2024-09-15T12:16:24.397 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-15T12:16:24.421 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-15T12:16:24.447 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:16:24.721 INFO:teuthology.orchestra.run.smithi071.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:16:24.722 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2024-09-15 12:16:24,721 seastar - Reactor backend: linux-aio 2024-09-15T12:16:24.727 INFO:teuthology.orchestra.run.smithi071.stderr:==28255==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:16:24.835 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x361553e 0x5fb945a 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:24.835 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:24.843 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2024-09-15 12:16:24,843 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-15T12:16:24.844 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2024-09-15 12:16:24,843 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 2-3 2024-09-15T12:16:24.844 INFO:teuthology.orchestra.run.smithi071.stderr:DEBUG 2024-09-15 12:16:24,844 [shard 0:main] seastar - reactor::drain 2024-09-15T12:16:25.343 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2024-09-15T12:16:25.343 INFO:teuthology.orchestra.run.smithi071.stderr:Suppressions used: 2024-09-15T12:16:25.343 INFO:teuthology.orchestra.run.smithi071.stderr: count bytes template 2024-09-15T12:16:25.343 INFO:teuthology.orchestra.run.smithi071.stderr: 1 8 MallocExtension::Register 2024-09-15T12:16:25.343 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2024-09-15T12:16:25.343 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-15T12:16:25.394 INFO:teuthology.orchestra.run.smithi071.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:16:25.398 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2024-09-15 12:16:25,397 seastar - Reactor backend: linux-aio 2024-09-15T12:16:25.411 INFO:teuthology.orchestra.run.smithi071.stderr:==28253==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:16:25.692 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9598930 0x9afa101 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-15T12:16:25.692 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:25.895 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9e33966 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:25.895 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:25.952 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x8b56c 0x10d76c 0xdd31a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:25.952 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x55426b1 0x9e3397b 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-15T12:16:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x55422d9 0x9e3396e 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-15T12:16:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:26.060 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab0b 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:26.060 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:26.146 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x554278e 0x9e3397b 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-15T12:16:26.146 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10252a 0x10d76c 0xdd31a 0x4ab1c 0x3ac7b0e 0x3b8c26d 0xb9e9267 0xb9ea53a 0xb9ea7b4 0xb9ea95c 0xb9ec717 0xb9ec913 0xba317fd 0xb9d8ccf 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9311f16 0x93129ba 0x9312a3d 0x9312ac2 0x9312bc4 0x9312cbc 0x9312d42 0x9312dfb 0x9312fb1 0x93130e9 0x9313164 0x93131e9 0x9313344 0x931345e 0x93134e3 0x93135c1 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-15T12:16:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:26.569 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4abc2 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:26.569 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x55427dc 0x9e3397b 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:27.585 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2024-09-15T12:16:27.585 INFO:teuthology.orchestra.run.smithi071.stderr:Suppressions used: 2024-09-15T12:16:27.586 INFO:teuthology.orchestra.run.smithi071.stderr: count bytes template 2024-09-15T12:16:27.586 INFO:teuthology.orchestra.run.smithi071.stderr: 1 8 MallocExtension::Register 2024-09-15T12:16:27.586 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2024-09-15T12:16:27.586 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-15T12:16:27.609 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-15T12:16:27.634 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:16:27.925 INFO:teuthology.orchestra.run.smithi071.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:16:27.926 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2024-09-15 12:16:27,925 seastar - Reactor backend: linux-aio 2024-09-15T12:16:27.931 INFO:teuthology.orchestra.run.smithi071.stderr:==28300==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:16:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2024-09-15 12:16:28,047 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-15T12:16:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2024-09-15 12:16:28,047 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 4-5 2024-09-15T12:16:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:DEBUG 2024-09-15 12:16:28,048 [shard 0:main] seastar - reactor::drain 2024-09-15T12:16:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2024-09-15T12:16:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:Suppressions used: 2024-09-15T12:16:28.562 INFO:teuthology.orchestra.run.smithi071.stderr: count bytes template 2024-09-15T12:16:28.562 INFO:teuthology.orchestra.run.smithi071.stderr: 1 8 MallocExtension::Register 2024-09-15T12:16:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2024-09-15T12:16:28.562 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-15T12:16:28.627 INFO:teuthology.orchestra.run.smithi071.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:16:28.631 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2024-09-15 12:16:28,630 seastar - Reactor backend: linux-aio 2024-09-15T12:16:28.644 INFO:teuthology.orchestra.run.smithi071.stderr:==28298==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:16:28.918 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xf9b73 0x3869f4d 0x386a307 0x386a570 0xb9cebf2 0x9843791 0x9af9974 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-15T12:16:28.919 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:29.117 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x156f9 0xdd312 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:29.117 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:29.174 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10797f 0xdd2e1 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:29.174 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:29.220 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542d97 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-15T12:16:29.221 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:29.278 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x55420de 0x9e33959 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-15T12:16:29.278 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:29.281 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab92 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:29.282 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:29.388 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xdd33a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-15T12:16:29.389 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:29.549 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 33 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xdd2dc 0x4ab1c 0x455068c 0xb9d216a 0xb9d2514 0xb9d27a0 0xb9d3595 0xb9d3a17 0xb9d3c2c 0xb9e7e93 0xb9e80d2 0xb9c4ff1 0xb9c50aa 0x9b1276d 0x997f56a 0x997f786 0x9942429 0x9942626 0x94cc913 0x94d0cb1 0x9251fbd 0x92523c8 0x92524a8 0x9271cae 0x9271f86 0x927203b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-15T12:16:29.549 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:29.784 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542000 0x9e33959 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:29.784 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:29.841 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x554278e 0x9e3397b 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:16:29.842 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2024-09-15T12:16:30.759 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2024-09-15T12:16:30.759 INFO:teuthology.orchestra.run.smithi071.stderr:Suppressions used: 2024-09-15T12:16:30.759 INFO:teuthology.orchestra.run.smithi071.stderr: count bytes template 2024-09-15T12:16:30.759 INFO:teuthology.orchestra.run.smithi071.stderr: 1 8 MallocExtension::Register 2024-09-15T12:16:30.759 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2024-09-15T12:16:30.759 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-15T12:16:30.783 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-15T12:16:30.808 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-15T12:16:30.808 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:30.808 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-15T12:16:30.873 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:30.873 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-15T12:16:30.937 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:30.938 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-15T12:16:31.002 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:31.002 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-15T12:16:31.067 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:31.067 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-15T12:16:31.123 INFO:tasks.ceph:Adding keys to all mons... 2024-09-15T12:16:31.123 DEBUG:teuthology.orchestra.run.smithi071:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T12:16:31.186 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.x] 2024-09-15T12:16:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAS0OZmq+knMhAAblkzGzmRJ8reMYMSOfOJIQ== 2024-09-15T12:16:31.186 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.0] 2024-09-15T12:16:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAW0OZm0jmbFRAA2M3CX22hZnnnZEgPXIDTWw== 2024-09-15T12:16:31.187 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.1] 2024-09-15T12:16:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAZ0OZmdDbzIBAAHdGr2YhdbjkgOl2UcOXY8Q== 2024-09-15T12:16:31.187 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.2] 2024-09-15T12:16:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAc0OZmkGiXLhAAy7mRPIImXpBghDv/rFECsQ== 2024-09-15T12:16:31.187 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2024-09-15T12:16:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAS0OZmU1RNNRAAP6DQ4QoXmKVCHg1SzXajrQ== 2024-09-15T12:16:31.188 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T12:16:31.289 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T12:16:31.351 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T12:16:31.412 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T12:16:31.473 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T12:16:31.536 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-15T12:16:31.536 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-15T12:16:31.561 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T12:16:31.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:31.670+0000 7f7f10143c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:31.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:31.670+0000 7f7f10143c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:31.686 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-15T12:16:31.711 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:16:31.766 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-15T12:16:31.767 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-15T12:16:31.767 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-15T12:16:31.809 INFO:tasks.ceph.mon.a:Started 2024-09-15T12:16:31.809 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-15T12:16:31.809 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-15T12:16:31.810 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-15T12:16:31.811 INFO:tasks.ceph.mgr.x:Started 2024-09-15T12:16:31.811 DEBUG:tasks.ceph:set 0 configs 2024-09-15T12:16:31.812 INFO:tasks.ceph:Setting crush tunables to default 2024-09-15T12:16:31.812 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd crush tunables default 2024-09-15T12:16:31.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-09-15T12:16:31.889+0000 7f1e81031c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:31.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-09-15T12:16:31.889+0000 7f1e81031c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:31.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-09-15T12:16:31.889+0000 7f1e81031c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:31.891 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-09-15T12:16:31.889+0000 7f657d5c1000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:31.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:31.914+0000 7feea886c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:31.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:31.924+0000 7feea886c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:31.994 INFO:teuthology.orchestra.run.smithi071.stderr:adjusted tunables profile to default 2024-09-15T12:16:32.006 INFO:tasks.ceph:check_enable_crimson: True 2024-09-15T12:16:32.006 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-15T12:16:32.006 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-15T12:16:32.097 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-09-15T12:16:32.096+0000 7f657d5c1000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:32.098 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-09-15T12:16:32.096+0000 7f657d5c1000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:32.105+0000 7fd596391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:32.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:32.114+0000 7fd596391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:32.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-09-15T12:16:32.194+0000 7f1e779f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-15T12:16:32.196 INFO:tasks.ceph.mon.a.smithi071.stderr:Please be aware that this feature is experimental, untested, 2024-09-15T12:16:32.196 INFO:tasks.ceph.mon.a.smithi071.stderr:unsupported, and may result in data corruption, data loss, 2024-09-15T12:16:32.196 INFO:tasks.ceph.mon.a.smithi071.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-15T12:16:32.196 INFO:tasks.ceph.mon.a.smithi071.stderr:feature with important data. 2024-09-15T12:16:32.196 INFO:tasks.ceph.mon.a.smithi071.stderr: 2024-09-15T12:16:33.007 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-15T12:16:33.008 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:33.008 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-15T12:16:33.032 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:33.033 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-15T12:16:33.097 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:16:33.097 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-15T12:16:33.162 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 3671ebe9-6279-457b-a77b-f8d2199c1af8 0 2024-09-15T12:16:33.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:33.303+0000 7f6f7f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:33.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:33.313+0000 7f6f7f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:33.392 INFO:teuthology.orchestra.run.smithi071.stdout:0 2024-09-15T12:16:33.403 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 59c182aa-1a80-4ae8-a9b5-0780af54aa23 1 2024-09-15T12:16:33.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:33.503+0000 7ff8cdd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:33.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:33.512+0000 7ff8cdd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:33.591 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-09-15T12:16:33.602 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 46acd69a-3bb8-4e7d-b6c7-1797498de197 2 2024-09-15T12:16:33.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:33.703+0000 7efeafd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:33.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:33.713+0000 7efeafd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:33.792 INFO:teuthology.orchestra.run.smithi071.stdout:2 2024-09-15T12:16:33.804 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-15T12:16:33.833 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-15T12:16:33.833 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-15T12:16:33.876 INFO:tasks.ceph.osd.0:Started 2024-09-15T12:16:33.876 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-15T12:16:33.905 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-15T12:16:33.905 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-15T12:16:33.948 INFO:tasks.ceph.osd.1:Started 2024-09-15T12:16:33.948 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-15T12:16:33.979 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-15T12:16:33.979 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-15T12:16:34.022 INFO:tasks.ceph.osd.2:Started 2024-09-15T12:16:34.022 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:16:34.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:34.139+0000 7ff4bcc74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:34.147+0000 7ff4bcc74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:34.246 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":6,"fsid":"15740f92-12c8-45c5-92c7-38ec03331077","created":"2024-09-15T12:16:31.911786+0000","modified":"2024-09-15T12:16:33.790814+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T12:16:33.790814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"3671ebe9-6279-457b-a77b-f8d2199c1af8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"59c182aa-1a80-4ae8-a9b5-0780af54aa23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46acd69a-3bb8-4e7d-b6c7-1797498de197","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:16:34.258 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-15T12:16:34.258 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-15T12:16:34.560 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T12:16:34.665 INFO:teuthology.misc.health.smithi071.stderr:2024-09-15T12:16:34.659+0000 7f185e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:34.668 INFO:teuthology.misc.health.smithi071.stderr:2024-09-15T12:16:34.667+0000 7f185e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:34.740 INFO:teuthology.misc.health.smithi071.stdout: 2024-09-15T12:16:34.740 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":6,"fsid":"15740f92-12c8-45c5-92c7-38ec03331077","created":"2024-09-15T12:16:31.911786+0000","modified":"2024-09-15T12:16:33.790814+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T12:16:33.790814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"3671ebe9-6279-457b-a77b-f8d2199c1af8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"59c182aa-1a80-4ae8-a9b5-0780af54aa23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46acd69a-3bb8-4e7d-b6c7-1797498de197","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:16:34.751 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-15T12:16:37.616 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-09-15T12:16:37.614+0000 7f651a78e640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-15T12:16:41.053 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T12:16:41.163 INFO:teuthology.misc.health.smithi071.stderr:2024-09-15T12:16:41.157+0000 7f329df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:41.166 INFO:teuthology.misc.health.smithi071.stderr:2024-09-15T12:16:41.165+0000 7f329df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:41.350 INFO:teuthology.misc.health.smithi071.stdout: 2024-09-15T12:16:41.350 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":10,"fsid":"15740f92-12c8-45c5-92c7-38ec03331077","created":"2024-09-15T12:16:31.911786+0000","modified":"2024-09-15T12:16:40.676710+0000","last_up_change":"2024-09-15T12:16:39.667128+0000","last_in_change":"2024-09-15T12:16:33.790814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:16:40.639465+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3671ebe9-6279-457b-a77b-f8d2199c1af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":3492089919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3492089919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":3492089919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3492089919}]},"public_addr":"172.21.15.71:6807/3492089919","cluster_addr":"172.21.15.71:6806/3492089919","heartbeat_back_addr":"172.21.15.71:6813/3492089919","heartbeat_front_addr":"172.21.15.71:6814/3492089919","state":["exists","up"]},{"osd":1,"uuid":"59c182aa-1a80-4ae8-a9b5-0780af54aa23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":2928762362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2928762362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2928762362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":2928762362}]},"public_addr":"172.21.15.71:6803/2928762362","cluster_addr":"172.21.15.71:6802/2928762362","heartbeat_back_addr":"172.21.15.71:6804/2928762362","heartbeat_front_addr":"172.21.15.71:6805/2928762362","state":["exists","up"]},{"osd":2,"uuid":"46acd69a-3bb8-4e7d-b6c7-1797498de197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1014999051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":1014999051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1014999051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":1014999051}]},"public_addr":"172.21.15.71:6808/1014999051","cluster_addr":"172.21.15.71:6809/1014999051","heartbeat_back_addr":"172.21.15.71:6810/1014999051","heartbeat_front_addr":"172.21.15.71:6811/1014999051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:16:41.361 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-15T12:16:41.361 INFO:tasks.ceph:Creating RBD pool 2024-09-15T12:16:41.362 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-15T12:16:41.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:41.459+0000 7f22ee591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:41.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:41.470+0000 7f22ee591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:41.684 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'rbd' created 2024-09-15T12:16:41.702 DEBUG:teuthology.orchestra.run.smithi071:> rbd --cluster ceph pool init rbd 2024-09-15T12:16:41.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:41.797+0000 7f2ac2fb9ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:41.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:41.797+0000 7f2ac2fb9ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:41.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:41.802+0000 7f2ac2fb9ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:44.759 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-15T12:16:44.760 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-15T12:16:44.760 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-15T12:16:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:44.862+0000 7f9bfc991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:44.870+0000 7f9bfc991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:45.057 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:45.070 INFO:teuthology.orchestra.run.smithi071.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-15T12:16:45.070 INFO:tasks.ceph_manager:config epoch is 1 2024-09-15T12:16:45.070 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T12:16:45.070 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-15T12:16:45.071 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-15T12:16:45.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:45.173+0000 7f07da391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:45.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:45.180+0000 7f07da391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:45.412 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:45.423 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":2076585499},{"type":"v1","addr":"172.21.15.71:6801","nonce":2076585499}]},"active_addr":"172.21.15.71:6801/2076585499","active_change":"2024-09-15T12:16:36.599038+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":503216225}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":4054441304}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":135301909}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1736200580}]}]} 2024-09-15T12:16:45.425 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-15T12:16:45.425 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-15T12:16:45.425 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:16:45.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:45.526+0000 7fe385591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:45.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:45.534+0000 7fe385591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:45.719 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:45.719 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":14,"fsid":"15740f92-12c8-45c5-92c7-38ec03331077","created":"2024-09-15T12:16:31.911786+0000","modified":"2024-09-15T12:16:44.695660+0000","last_up_change":"2024-09-15T12:16:39.667128+0000","last_in_change":"2024-09-15T12:16:33.790814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:16:40.639465+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T12:16:41.660063+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3671ebe9-6279-457b-a77b-f8d2199c1af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":3492089919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3492089919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":3492089919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3492089919}]},"public_addr":"172.21.15.71:6807/3492089919","cluster_addr":"172.21.15.71:6806/3492089919","heartbeat_back_addr":"172.21.15.71:6813/3492089919","heartbeat_front_addr":"172.21.15.71:6814/3492089919","state":["exists","up"]},{"osd":1,"uuid":"59c182aa-1a80-4ae8-a9b5-0780af54aa23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":2928762362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2928762362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2928762362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":2928762362}]},"public_addr":"172.21.15.71:6803/2928762362","cluster_addr":"172.21.15.71:6802/2928762362","heartbeat_back_addr":"172.21.15.71:6804/2928762362","heartbeat_front_addr":"172.21.15.71:6805/2928762362","state":["exists","up"]},{"osd":2,"uuid":"46acd69a-3bb8-4e7d-b6c7-1797498de197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1014999051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":1014999051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1014999051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":1014999051}]},"public_addr":"172.21.15.71:6808/1014999051","cluster_addr":"172.21.15.71:6809/1014999051","heartbeat_back_addr":"172.21.15.71:6810/1014999051","heartbeat_front_addr":"172.21.15.71:6811/1014999051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:16:45.732 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-15T12:16:45.732 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:16:45.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:45.834+0000 7f4a69751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:45.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:45.841+0000 7f4a69751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:46.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:46.028 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":14,"fsid":"15740f92-12c8-45c5-92c7-38ec03331077","created":"2024-09-15T12:16:31.911786+0000","modified":"2024-09-15T12:16:44.695660+0000","last_up_change":"2024-09-15T12:16:39.667128+0000","last_in_change":"2024-09-15T12:16:33.790814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:16:40.639465+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T12:16:41.660063+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3671ebe9-6279-457b-a77b-f8d2199c1af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":3492089919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3492089919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":3492089919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3492089919}]},"public_addr":"172.21.15.71:6807/3492089919","cluster_addr":"172.21.15.71:6806/3492089919","heartbeat_back_addr":"172.21.15.71:6813/3492089919","heartbeat_front_addr":"172.21.15.71:6814/3492089919","state":["exists","up"]},{"osd":1,"uuid":"59c182aa-1a80-4ae8-a9b5-0780af54aa23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":2928762362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2928762362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2928762362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":2928762362}]},"public_addr":"172.21.15.71:6803/2928762362","cluster_addr":"172.21.15.71:6802/2928762362","heartbeat_back_addr":"172.21.15.71:6804/2928762362","heartbeat_front_addr":"172.21.15.71:6805/2928762362","state":["exists","up"]},{"osd":2,"uuid":"46acd69a-3bb8-4e7d-b6c7-1797498de197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1014999051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":1014999051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1014999051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":1014999051}]},"public_addr":"172.21.15.71:6808/1014999051","cluster_addr":"172.21.15.71:6809/1014999051","heartbeat_back_addr":"172.21.15.71:6810/1014999051","heartbeat_front_addr":"172.21.15.71:6811/1014999051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:16:46.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-15T12:16:46.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-15T12:16:46.042 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-15T12:16:46.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:46.149+0000 7f6defcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:46.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:46.149+0000 7fddcb8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:46.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:46.149+0000 7f96b6b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:46.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:46.158+0000 7f6defcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:46.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:46.158+0000 7f96b6b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:46.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:46.158+0000 7fddcb8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:46.190 INFO:teuthology.orchestra.run.smithi071.stdout:34359738375 2024-09-15T12:16:46.190 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T12:16:46.193 INFO:teuthology.orchestra.run.smithi071.stdout:38654705670 2024-09-15T12:16:46.193 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T12:16:46.195 INFO:teuthology.orchestra.run.smithi071.stdout:38654705670 2024-09-15T12:16:46.195 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T12:16:46.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:46.298+0000 7ff097991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:46.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:46.308+0000 7ff097991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:46.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:46.342+0000 7f82ca991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:46.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:46.342+0000 7fb0b287d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:46.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:46.351+0000 7fb0b287d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:46.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:46.351+0000 7f82ca991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:46.508 INFO:teuthology.orchestra.run.smithi071.stdout:34359738375 2024-09-15T12:16:46.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.1 2024-09-15T12:16:46.522 DEBUG:teuthology.parallel:result is None 2024-09-15T12:16:46.550 INFO:teuthology.orchestra.run.smithi071.stdout:38654705670 2024-09-15T12:16:46.556 INFO:teuthology.orchestra.run.smithi071.stdout:38654705670 2024-09-15T12:16:46.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-09-15T12:16:46.564 DEBUG:teuthology.parallel:result is None 2024-09-15T12:16:46.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2024-09-15T12:16:46.569 DEBUG:teuthology.parallel:result is None 2024-09-15T12:16:46.570 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T12:16:46.570 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:16:46.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:46.714+0000 7f04fb151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:46.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:46.721+0000 7f04fb151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:46.905 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-15T12:16:46.918 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-15T12:16:46.606022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":3348,"kb_used_data":3348,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156889836,"statfs":{"total":160658620416,"available":160655192064,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.424833"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.719741+0000","last_change":"2024-09-15T12:16:44.732654+0000","last_active":"2024-09-15T12:16:44.719741+0000","last_peered":"2024-09-15T12:16:44.719741+0000","last_clean":"2024-09-15T12:16:44.719741+0000","last_became_active":"2024-09-15T12:16:42.803733+0000","last_became_peered":"2024-09-15T12:16:42.803733+0000","last_unstale":"2024-09-15T12:16:44.719741+0000","last_undegraded":"2024-09-15T12:16:44.719741+0000","last_fullsized":"2024-09-15T12:16:44.719741+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.731488+0000","last_change":"2024-09-15T12:16:44.737389+0000","last_active":"2024-09-15T12:16:44.731488+0000","last_peered":"2024-09-15T12:16:44.731488+0000","last_clean":"2024-09-15T12:16:44.731488+0000","last_became_active":"2024-09-15T12:16:42.870264+0000","last_became_peered":"2024-09-15T12:16:42.870264+0000","last_unstale":"2024-09-15T12:16:44.731488+0000","last_undegraded":"2024-09-15T12:16:44.731488+0000","last_fullsized":"2024-09-15T12:16:44.731488+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.724800+0000","last_change":"2024-09-15T12:16:44.733449+0000","last_active":"2024-09-15T12:16:44.724800+0000","last_peered":"2024-09-15T12:16:44.724800+0000","last_clean":"2024-09-15T12:16:44.724800+0000","last_became_active":"2024-09-15T12:16:42.826421+0000","last_became_peered":"2024-09-15T12:16:42.826421+0000","last_unstale":"2024-09-15T12:16:44.724800+0000","last_undegraded":"2024-09-15T12:16:44.724800+0000","last_fullsized":"2024-09-15T12:16:44.724800+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.722692+0000","last_change":"2024-09-15T12:16:44.733581+0000","last_active":"2024-09-15T12:16:44.722692+0000","last_peered":"2024-09-15T12:16:44.722692+0000","last_clean":"2024-09-15T12:16:44.722692+0000","last_became_active":"2024-09-15T12:16:42.813424+0000","last_became_peered":"2024-09-15T12:16:42.813424+0000","last_unstale":"2024-09-15T12:16:44.722692+0000","last_undegraded":"2024-09-15T12:16:44.722692+0000","last_fullsized":"2024-09-15T12:16:44.722692+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.737394+0000","last_change":"2024-09-15T12:16:44.737394+0000","last_active":"2024-09-15T12:16:44.737394+0000","last_peered":"2024-09-15T12:16:44.737394+0000","last_clean":"2024-09-15T12:16:44.737394+0000","last_became_active":"2024-09-15T12:16:42.877184+0000","last_became_peered":"2024-09-15T12:16:42.877184+0000","last_unstale":"2024-09-15T12:16:44.737394+0000","last_undegraded":"2024-09-15T12:16:44.737394+0000","last_fullsized":"2024-09-15T12:16:44.737394+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.732378+0000","last_change":"2024-09-15T12:16:44.736299+0000","last_active":"2024-09-15T12:16:44.732378+0000","last_peered":"2024-09-15T12:16:44.732378+0000","last_clean":"2024-09-15T12:16:44.732378+0000","last_became_active":"2024-09-15T12:16:42.859171+0000","last_became_peered":"2024-09-15T12:16:42.859171+0000","last_unstale":"2024-09-15T12:16:44.732378+0000","last_undegraded":"2024-09-15T12:16:44.732378+0000","last_fullsized":"2024-09-15T12:16:44.732378+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.727084+0000","last_change":"2024-09-15T12:16:44.731224+0000","last_active":"2024-09-15T12:16:44.727084+0000","last_peered":"2024-09-15T12:16:44.727084+0000","last_clean":"2024-09-15T12:16:44.727084+0000","last_became_active":"2024-09-15T12:16:42.822882+0000","last_became_peered":"2024-09-15T12:16:42.822882+0000","last_unstale":"2024-09-15T12:16:44.727084+0000","last_undegraded":"2024-09-15T12:16:44.727084+0000","last_fullsized":"2024-09-15T12:16:44.727084+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.729938+0000","last_change":"2024-09-15T12:16:44.737015+0000","last_active":"2024-09-15T12:16:44.729938+0000","last_peered":"2024-09-15T12:16:44.729938+0000","last_clean":"2024-09-15T12:16:44.729938+0000","last_became_active":"2024-09-15T12:16:42.824114+0000","last_became_peered":"2024-09-15T12:16:42.824114+0000","last_unstale":"2024-09-15T12:16:44.729938+0000","last_undegraded":"2024-09-15T12:16:44.729938+0000","last_fullsized":"2024-09-15T12:16:44.729938+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":84,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.723537+0000","last_change":"2024-09-15T12:16:41.767801+0000","last_active":"2024-09-15T12:16:44.723537+0000","last_peered":"2024-09-15T12:16:44.723537+0000","last_clean":"2024-09-15T12:16:44.723537+0000","last_became_active":"2024-09-15T12:16:41.746909+0000","last_became_peered":"2024-09-15T12:16:41.746909+0000","last_unstale":"2024-09-15T12:16:44.723537+0000","last_undegraded":"2024-09-15T12:16:44.723537+0000","last_fullsized":"2024-09-15T12:16:44.723537+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:40.676710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:40.676710+0000","last_clean_scrub_stamp":"2024-09-15T12:16:40.676710+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160655192064,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":428,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297300,"statfs":{"total":53552873472,"available":53552435200,"internally_reserved":0,"allocated":438272,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1588,"kb_used_data":1588,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296140,"statfs":{"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1332,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296396,"statfs":{"total":53552873472,"available":53551509504,"internally_reserved":0,"allocated":1363968,"data_stored":1363968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551509504,"internally_reserved":0,"allocated":1363968,"data_stored":1363968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552435200,"internally_reserved":0,"allocated":438272,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:16:46.919 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:16:47.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:47.022+0000 7f6e9fac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:47.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:47.030+0000 7f6e9fac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:47.213 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:47.213 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-15T12:16:47.226 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-15T12:16:46.606022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":3348,"kb_used_data":3348,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156889836,"statfs":{"total":160658620416,"available":160655192064,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.424833"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.719741+0000","last_change":"2024-09-15T12:16:44.732654+0000","last_active":"2024-09-15T12:16:44.719741+0000","last_peered":"2024-09-15T12:16:44.719741+0000","last_clean":"2024-09-15T12:16:44.719741+0000","last_became_active":"2024-09-15T12:16:42.803733+0000","last_became_peered":"2024-09-15T12:16:42.803733+0000","last_unstale":"2024-09-15T12:16:44.719741+0000","last_undegraded":"2024-09-15T12:16:44.719741+0000","last_fullsized":"2024-09-15T12:16:44.719741+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.731488+0000","last_change":"2024-09-15T12:16:44.737389+0000","last_active":"2024-09-15T12:16:44.731488+0000","last_peered":"2024-09-15T12:16:44.731488+0000","last_clean":"2024-09-15T12:16:44.731488+0000","last_became_active":"2024-09-15T12:16:42.870264+0000","last_became_peered":"2024-09-15T12:16:42.870264+0000","last_unstale":"2024-09-15T12:16:44.731488+0000","last_undegraded":"2024-09-15T12:16:44.731488+0000","last_fullsized":"2024-09-15T12:16:44.731488+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.724800+0000","last_change":"2024-09-15T12:16:44.733449+0000","last_active":"2024-09-15T12:16:44.724800+0000","last_peered":"2024-09-15T12:16:44.724800+0000","last_clean":"2024-09-15T12:16:44.724800+0000","last_became_active":"2024-09-15T12:16:42.826421+0000","last_became_peered":"2024-09-15T12:16:42.826421+0000","last_unstale":"2024-09-15T12:16:44.724800+0000","last_undegraded":"2024-09-15T12:16:44.724800+0000","last_fullsized":"2024-09-15T12:16:44.724800+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.722692+0000","last_change":"2024-09-15T12:16:44.733581+0000","last_active":"2024-09-15T12:16:44.722692+0000","last_peered":"2024-09-15T12:16:44.722692+0000","last_clean":"2024-09-15T12:16:44.722692+0000","last_became_active":"2024-09-15T12:16:42.813424+0000","last_became_peered":"2024-09-15T12:16:42.813424+0000","last_unstale":"2024-09-15T12:16:44.722692+0000","last_undegraded":"2024-09-15T12:16:44.722692+0000","last_fullsized":"2024-09-15T12:16:44.722692+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.737394+0000","last_change":"2024-09-15T12:16:44.737394+0000","last_active":"2024-09-15T12:16:44.737394+0000","last_peered":"2024-09-15T12:16:44.737394+0000","last_clean":"2024-09-15T12:16:44.737394+0000","last_became_active":"2024-09-15T12:16:42.877184+0000","last_became_peered":"2024-09-15T12:16:42.877184+0000","last_unstale":"2024-09-15T12:16:44.737394+0000","last_undegraded":"2024-09-15T12:16:44.737394+0000","last_fullsized":"2024-09-15T12:16:44.737394+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.732378+0000","last_change":"2024-09-15T12:16:44.736299+0000","last_active":"2024-09-15T12:16:44.732378+0000","last_peered":"2024-09-15T12:16:44.732378+0000","last_clean":"2024-09-15T12:16:44.732378+0000","last_became_active":"2024-09-15T12:16:42.859171+0000","last_became_peered":"2024-09-15T12:16:42.859171+0000","last_unstale":"2024-09-15T12:16:44.732378+0000","last_undegraded":"2024-09-15T12:16:44.732378+0000","last_fullsized":"2024-09-15T12:16:44.732378+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.727084+0000","last_change":"2024-09-15T12:16:44.731224+0000","last_active":"2024-09-15T12:16:44.727084+0000","last_peered":"2024-09-15T12:16:44.727084+0000","last_clean":"2024-09-15T12:16:44.727084+0000","last_became_active":"2024-09-15T12:16:42.822882+0000","last_became_peered":"2024-09-15T12:16:42.822882+0000","last_unstale":"2024-09-15T12:16:44.727084+0000","last_undegraded":"2024-09-15T12:16:44.727084+0000","last_fullsized":"2024-09-15T12:16:44.727084+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.729938+0000","last_change":"2024-09-15T12:16:44.737015+0000","last_active":"2024-09-15T12:16:44.729938+0000","last_peered":"2024-09-15T12:16:44.729938+0000","last_clean":"2024-09-15T12:16:44.729938+0000","last_became_active":"2024-09-15T12:16:42.824114+0000","last_became_peered":"2024-09-15T12:16:42.824114+0000","last_unstale":"2024-09-15T12:16:44.729938+0000","last_undegraded":"2024-09-15T12:16:44.729938+0000","last_fullsized":"2024-09-15T12:16:44.729938+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":84,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-15T12:16:44.723537+0000","last_change":"2024-09-15T12:16:41.767801+0000","last_active":"2024-09-15T12:16:44.723537+0000","last_peered":"2024-09-15T12:16:44.723537+0000","last_clean":"2024-09-15T12:16:44.723537+0000","last_became_active":"2024-09-15T12:16:41.746909+0000","last_became_peered":"2024-09-15T12:16:41.746909+0000","last_unstale":"2024-09-15T12:16:44.723537+0000","last_undegraded":"2024-09-15T12:16:44.723537+0000","last_fullsized":"2024-09-15T12:16:44.723537+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:40.676710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:40.676710+0000","last_clean_scrub_stamp":"2024-09-15T12:16:40.676710+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160655192064,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":428,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297300,"statfs":{"total":53552873472,"available":53552435200,"internally_reserved":0,"allocated":438272,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1588,"kb_used_data":1588,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296140,"statfs":{"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1332,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296396,"statfs":{"total":53552873472,"available":53551509504,"internally_reserved":0,"allocated":1363968,"data_stored":1363968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551509504,"internally_reserved":0,"allocated":1363968,"data_stored":1363968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551247360,"internally_reserved":0,"allocated":1626112,"data_stored":1626112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552435200,"internally_reserved":0,"allocated":438272,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:16:47.226 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T12:16:47.226 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T12:16:47.226 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-15T12:16:47.227 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-15T12:16:47.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:47.328+0000 7f06a005c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:47.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:16:47.334+0000 7f06a005c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:16:47.556 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:16:47.556 INFO:teuthology.orchestra.run.smithi071.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T12:16:47.569 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-15T12:16:47.569 INFO:teuthology.run_tasks:Running task workunit... 2024-09-15T12:16:47.583 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-15T12:16:47.584 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-15T12:16:47.584 DEBUG:teuthology.orchestra.run.smithi071:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-15T12:16:47.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:16:47.599 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-15T12:16:47.600 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-15T12:16:47.656 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-15T12:16:47.656 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-15T12:16:47.712 INFO:tasks.workunit:timeout=3h 2024-09-15T12:16:47.712 INFO:tasks.workunit:cleanup=True 2024-09-15T12:16:47.713 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-15T12:16:47.769 INFO:tasks.workunit.client.0.smithi071.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-15T12:17:38.577 INFO:tasks.workunit.client.0.smithi071.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-09-15T12:17:38.577 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-15T12:17:38.577 INFO:tasks.workunit.client.0.smithi071.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-15T12:17:38.577 INFO:tasks.workunit.client.0.smithi071.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-15T12:17:38.578 INFO:tasks.workunit.client.0.smithi071.stderr:state without impacting any branches by switching back to a branch. 2024-09-15T12:17:38.578 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-15T12:17:38.578 INFO:tasks.workunit.client.0.smithi071.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-15T12:17:38.578 INFO:tasks.workunit.client.0.smithi071.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-15T12:17:38.578 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-15T12:17:38.578 INFO:tasks.workunit.client.0.smithi071.stderr: git switch -c 2024-09-15T12:17:38.578 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-15T12:17:38.578 INFO:tasks.workunit.client.0.smithi071.stderr:Or undo this operation with: 2024-09-15T12:17:38.578 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-15T12:17:38.578 INFO:tasks.workunit.client.0.smithi071.stderr: git switch - 2024-09-15T12:17:38.578 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-15T12:17:38.578 INFO:tasks.workunit.client.0.smithi071.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-15T12:17:38.578 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-15T12:17:38.579 INFO:tasks.workunit.client.0.smithi071.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-09-15T12:17:38.581 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-15T12:17:38.642 INFO:tasks.workunit.client.0.smithi071.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-15T12:17:38.645 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T12:17:38.645 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-15T12:17:39.300 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-15T12:17:39.375 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-15T12:17:39.414 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T12:17:39.416 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T12:17:39.416 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-15T12:17:39.454 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T12:17:39.458 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-15T12:17:39.458 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-15T12:17:39.514 INFO:tasks.workunit:Running workunits matching rbd/crimson/test_crimson_librbd.sh on client.0... 2024-09-15T12:17:39.515 INFO:tasks.workunit:Running workunit rbd/crimson/test_crimson_librbd.sh... 2024-09-15T12:17:39.515 DEBUG:teuthology.orchestra.run.smithi071:workunit test rbd/crimson/test_crimson_librbd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh 2024-09-15T12:17:39.621 INFO:tasks.workunit.client.0.smithi071.stdout:seed 30174 2024-09-15T12:17:39.621 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = TestLibRBD.* 2024-09-15T12:17:39.621 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 171 tests from 1 test suite. 2024-09-15T12:17:39.621 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:17:39.621 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 171 tests from TestLibRBD 2024-09-15T12:17:39.666 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.CreateAndStat 2024-09-15T12:17:40.951 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:43.109 INFO:tasks.workunit.client.0.smithi071.stdout:image has size 2097152 and order 22 2024-09-15T12:17:43.109 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.CreateAndStat (3442 ms) 2024-09-15T12:17:43.109 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.CreateWithSameDataPool 2024-09-15T12:17:43.110 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:780: Skipped 2024-09-15T12:17:43.110 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:17:43.110 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.CreateWithSameDataPool (0 ms) 2024-09-15T12:17:43.110 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.CreateAndStatPP 2024-09-15T12:17:43.110 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:43.212 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.CreateAndStatPP (103 ms) 2024-09-15T12:17:43.212 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.GetId 2024-09-15T12:17:43.212 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:43.312 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.GetId (100 ms) 2024-09-15T12:17:43.312 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.GetIdPP 2024-09-15T12:17:43.312 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:43.425 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.GetIdPP (114 ms) 2024-09-15T12:17:43.425 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefix 2024-09-15T12:17:43.426 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:43.532 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.GetBlockNamePrefix (106 ms) 2024-09-15T12:17:43.532 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefixPP 2024-09-15T12:17:43.532 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:43.631 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.GetBlockNamePrefixPP (99 ms) 2024-09-15T12:17:43.631 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestGetCreateTimestamp 2024-09-15T12:17:43.631 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:939: Skipped 2024-09-15T12:17:43.631 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:17:43.631 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestGetCreateTimestamp (0 ms) 2024-09-15T12:17:43.631 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.GetCreateTimestampPP 2024-09-15T12:17:43.631 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:962: Skipped 2024-09-15T12:17:43.631 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:17:43.631 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.GetCreateTimestampPP (0 ms) 2024-09-15T12:17:43.631 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.OpenAio 2024-09-15T12:17:43.632 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:43.732 INFO:tasks.workunit.client.0.smithi071.stdout:image has size 2097152 and order 22 2024-09-15T12:17:43.732 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.OpenAio (101 ms) 2024-09-15T12:17:43.732 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.OpenAioFail 2024-09-15T12:17:43.744 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.OpenAioFail (12 ms) 2024-09-15T12:17:43.744 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.OpenAioPP 2024-09-15T12:17:43.744 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:43.906 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.OpenAioPP (163 ms) 2024-09-15T12:17:43.906 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.OpenAioFailPP 2024-09-15T12:17:43.920 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.OpenAioFailPP (13 ms) 2024-09-15T12:17:43.920 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ResizeAndStat 2024-09-15T12:17:43.920 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:44.170 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.ResizeAndStat (250 ms) 2024-09-15T12:17:44.170 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ResizeAndStatPP 2024-09-15T12:17:44.170 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:44.366 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.ResizeAndStatPP (196 ms) 2024-09-15T12:17:44.366 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResize 2024-09-15T12:17:44.366 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:44.597 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.UpdateWatchAndResize (231 ms) 2024-09-15T12:17:44.597 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResizePP 2024-09-15T12:17:44.597 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:44.834 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.UpdateWatchAndResizePP (238 ms) 2024-09-15T12:17:44.835 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCreateLsDelete 2024-09-15T12:17:46.593 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:48.110 INFO:tasks.workunit.client.0.smithi071.stdout:image: image15 2024-09-15T12:17:48.110 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image15 2024-09-15T12:17:48.110 INFO:tasks.workunit.client.0.smithi071.stdout:found image15 2024-09-15T12:17:48.110 INFO:tasks.workunit.client.0.smithi071.stdout:erased image15 2024-09-15T12:17:48.110 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:48.378 INFO:tasks.workunit.client.0.smithi071.stdout:image: image15 2024-09-15T12:17:48.378 INFO:tasks.workunit.client.0.smithi071.stdout:image: image16 2024-09-15T12:17:48.378 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image15 2024-09-15T12:17:48.379 INFO:tasks.workunit.client.0.smithi071.stdout:found image15 2024-09-15T12:17:48.379 INFO:tasks.workunit.client.0.smithi071.stdout:erased image15 2024-09-15T12:17:48.379 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image16 2024-09-15T12:17:48.379 INFO:tasks.workunit.client.0.smithi071.stdout:found image16 2024-09-15T12:17:48.379 INFO:tasks.workunit.client.0.smithi071.stdout:erased image16 2024-09-15T12:17:48.379 INFO:tasks.workunit.client.0.smithi071.stdout:image: image16 2024-09-15T12:17:48.379 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image16 2024-09-15T12:17:48.379 INFO:tasks.workunit.client.0.smithi071.stdout:found image16 2024-09-15T12:17:48.379 INFO:tasks.workunit.client.0.smithi071.stdout:erased image16 2024-09-15T12:17:48.379 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCreateLsDelete (3544 ms) 2024-09-15T12:17:48.379 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCreateLsDeletePP 2024-09-15T12:17:49.990 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:52.169 INFO:tasks.workunit.client.0.smithi071.stdout:num images is: 1 2024-09-15T12:17:52.169 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 1 2024-09-15T12:17:52.169 INFO:tasks.workunit.client.0.smithi071.stdout:image: image17 2024-09-15T12:17:52.169 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image17 2024-09-15T12:17:52.169 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:17:52.231 INFO:tasks.workunit.client.0.smithi071.stdout:num images is: 2 2024-09-15T12:17:52.231 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 2 2024-09-15T12:17:52.231 INFO:tasks.workunit.client.0.smithi071.stdout:image: image17 2024-09-15T12:17:52.231 INFO:tasks.workunit.client.0.smithi071.stdout:image: image18 2024-09-15T12:17:52.231 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image17 2024-09-15T12:17:52.231 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image18 2024-09-15T12:17:52.361 INFO:tasks.workunit.client.0.smithi071.stdout:num images is: 1 2024-09-15T12:17:52.361 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 1 2024-09-15T12:17:52.361 INFO:tasks.workunit.client.0.smithi071.stdout:image: image18 2024-09-15T12:17:52.361 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image18 2024-09-15T12:17:52.361 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCreateLsDeletePP (3982 ms) 2024-09-15T12:17:52.361 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCopy 2024-09-15T12:17:54.011 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:18:03.040 INFO:tasks.workunit.client.0.smithi071.stdout:image: image19 2024-09-15T12:18:03.040 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image19 2024-09-15T12:18:03.041 INFO:tasks.workunit.client.0.smithi071.stdout:found image19 2024-09-15T12:18:03.041 INFO:tasks.workunit.client.0.smithi071.stdout:erased image19 2024-09-15T12:18:03.041 INFO:tasks.workunit.client.0.smithi071.stdout:image: image19 2024-09-15T12:18:03.041 INFO:tasks.workunit.client.0.smithi071.stdout:image: image20 2024-09-15T12:18:03.041 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image19 2024-09-15T12:18:03.041 INFO:tasks.workunit.client.0.smithi071.stdout:found image19 2024-09-15T12:18:03.041 INFO:tasks.workunit.client.0.smithi071.stdout:erased image19 2024-09-15T12:18:03.041 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image20 2024-09-15T12:18:03.041 INFO:tasks.workunit.client.0.smithi071.stdout:found image20 2024-09-15T12:18:03.041 INFO:tasks.workunit.client.0.smithi071.stdout:erased image20 2024-09-15T12:18:03.041 INFO:tasks.workunit.client.0.smithi071.stdout:0.00% done 2024-09-15T12:18:03.041 INFO:tasks.workunit.client.0.smithi071.stdout:100.00% done 2024-09-15T12:18:03.042 INFO:tasks.workunit.client.0.smithi071.stdout:image: image19 2024-09-15T12:18:03.042 INFO:tasks.workunit.client.0.smithi071.stdout:image: image20 2024-09-15T12:18:03.042 INFO:tasks.workunit.client.0.smithi071.stdout:image: image21 2024-09-15T12:18:03.042 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image19 2024-09-15T12:18:03.042 INFO:tasks.workunit.client.0.smithi071.stdout:found image19 2024-09-15T12:18:03.042 INFO:tasks.workunit.client.0.smithi071.stdout:erased image19 2024-09-15T12:18:03.042 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image20 2024-09-15T12:18:03.042 INFO:tasks.workunit.client.0.smithi071.stdout:found image20 2024-09-15T12:18:03.042 INFO:tasks.workunit.client.0.smithi071.stdout:erased image20 2024-09-15T12:18:03.042 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image21 2024-09-15T12:18:03.042 INFO:tasks.workunit.client.0.smithi071.stdout:found image21 2024-09-15T12:18:03.042 INFO:tasks.workunit.client.0.smithi071.stdout:erased image21 2024-09-15T12:18:03.042 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCopy (10679 ms) 2024-09-15T12:18:03.042 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCopyPP 2024-09-15T12:18:05.057 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:18:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:num images is: 1 2024-09-15T12:18:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 1 2024-09-15T12:18:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:image: image22 2024-09-15T12:18:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image22 2024-09-15T12:18:12.491 INFO:tasks.workunit.client.0.smithi071.stdout:num images is: 2 2024-09-15T12:18:12.491 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 2 2024-09-15T12:18:12.492 INFO:tasks.workunit.client.0.smithi071.stdout:image: image22 2024-09-15T12:18:12.492 INFO:tasks.workunit.client.0.smithi071.stdout:image: image23 2024-09-15T12:18:12.492 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image22 2024-09-15T12:18:12.492 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image23 2024-09-15T12:18:13.324 INFO:tasks.workunit.client.0.smithi071.stdout:0.00% done 2024-09-15T12:18:13.324 INFO:tasks.workunit.client.0.smithi071.stdout:100.00% done 2024-09-15T12:18:13.324 INFO:tasks.workunit.client.0.smithi071.stdout:num images is: 3 2024-09-15T12:18:13.324 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 3 2024-09-15T12:18:13.324 INFO:tasks.workunit.client.0.smithi071.stdout:image: image22 2024-09-15T12:18:13.324 INFO:tasks.workunit.client.0.smithi071.stdout:image: image23 2024-09-15T12:18:13.324 INFO:tasks.workunit.client.0.smithi071.stdout:image: image24 2024-09-15T12:18:13.324 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image22 2024-09-15T12:18:13.325 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image23 2024-09-15T12:18:13.325 INFO:tasks.workunit.client.0.smithi071.stdout:expected = image24 2024-09-15T12:18:14.010 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCopyPP (10970 ms) 2024-09-15T12:18:14.010 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestDeepCopy 2024-09-15T12:18:14.010 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:1578: Skipped 2024-09-15T12:18:14.010 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:18:14.010 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopy (0 ms) 2024-09-15T12:18:14.010 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestDeepCopyPP 2024-09-15T12:18:14.010 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:1745: Skipped 2024-09-15T12:18:14.010 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:18:14.010 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopyPP (0 ms) 2024-09-15T12:18:14.010 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnap 2024-09-15T12:18:14.010 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:18:18.343 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 1 2024-09-15T12:18:18.344 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 1 2024-09-15T12:18:18.344 INFO:tasks.workunit.client.0.smithi071.stdout:snap: snap1 2024-09-15T12:18:18.344 INFO:tasks.workunit.client.0.smithi071.stdout:found snap1 with size 2097152 2024-09-15T12:18:18.344 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 2 2024-09-15T12:18:18.344 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 2 2024-09-15T12:18:18.344 INFO:tasks.workunit.client.0.smithi071.stdout:snap: snap1 2024-09-15T12:18:18.344 INFO:tasks.workunit.client.0.smithi071.stdout:snap: snap2 2024-09-15T12:18:18.344 INFO:tasks.workunit.client.0.smithi071.stdout:found snap1 with size 2097152 2024-09-15T12:18:18.344 INFO:tasks.workunit.client.0.smithi071.stdout:found snap2 with size 4194304 2024-09-15T12:18:18.344 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 1 2024-09-15T12:18:18.344 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 1 2024-09-15T12:18:18.344 INFO:tasks.workunit.client.0.smithi071.stdout:snap: snap2 2024-09-15T12:18:18.344 INFO:tasks.workunit.client.0.smithi071.stdout:found snap2 with size 4194304 2024-09-15T12:18:18.345 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 0 2024-09-15T12:18:18.345 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 0 2024-09-15T12:18:18.345 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnap (4334 ms) 2024-09-15T12:18:18.345 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestGetSnapShotTimeStamp 2024-09-15T12:18:18.345 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:1890: Skipped 2024-09-15T12:18:18.345 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:18:18.345 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestGetSnapShotTimeStamp (0 ms) 2024-09-15T12:18:18.345 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnapPP 2024-09-15T12:18:18.345 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:18:19.253 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 1 2024-09-15T12:18:19.253 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 1 2024-09-15T12:18:19.253 INFO:tasks.workunit.client.0.smithi071.stdout:snap: snap1 2024-09-15T12:18:19.254 INFO:tasks.workunit.client.0.smithi071.stdout:found snap1 with size 2097152 2024-09-15T12:18:20.265 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 2 2024-09-15T12:18:20.265 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 2 2024-09-15T12:18:20.265 INFO:tasks.workunit.client.0.smithi071.stdout:snap: snap1 2024-09-15T12:18:20.266 INFO:tasks.workunit.client.0.smithi071.stdout:snap: snap2 2024-09-15T12:18:20.266 INFO:tasks.workunit.client.0.smithi071.stdout:found snap1 with size 2097152 2024-09-15T12:18:20.266 INFO:tasks.workunit.client.0.smithi071.stdout:found snap2 with size 4194304 2024-09-15T12:18:21.329 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 1 2024-09-15T12:18:21.329 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 1 2024-09-15T12:18:21.329 INFO:tasks.workunit.client.0.smithi071.stdout:snap: snap2 2024-09-15T12:18:21.329 INFO:tasks.workunit.client.0.smithi071.stdout:found snap2 with size 4194304 2024-09-15T12:18:22.320 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 0 2024-09-15T12:18:22.321 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 0 2024-09-15T12:18:22.341 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnapPP (3997 ms) 2024-09-15T12:18:22.341 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestGetNameIdSnapPP 2024-09-15T12:18:22.341 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:18:28.298 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 0 2024-09-15T12:18:28.298 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 0 2024-09-15T12:18:28.313 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestGetNameIdSnapPP (5972 ms) 2024-09-15T12:18:28.313 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCreateLsRenameSnapPP 2024-09-15T12:18:28.313 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:18:29.362 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 1 2024-09-15T12:18:29.362 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 1 2024-09-15T12:18:29.362 INFO:tasks.workunit.client.0.smithi071.stdout:snap: snap1 2024-09-15T12:18:29.362 INFO:tasks.workunit.client.0.smithi071.stdout:found snap1 with size 2097152 2024-09-15T12:18:30.325 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 2 2024-09-15T12:18:30.325 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 2 2024-09-15T12:18:30.325 INFO:tasks.workunit.client.0.smithi071.stdout:snap: snap1 2024-09-15T12:18:30.325 INFO:tasks.workunit.client.0.smithi071.stdout:snap: snap2 2024-09-15T12:18:30.325 INFO:tasks.workunit.client.0.smithi071.stdout:found snap1 with size 2097152 2024-09-15T12:18:30.325 INFO:tasks.workunit.client.0.smithi071.stdout:found snap2 with size 4194304 2024-09-15T12:18:30.382 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 2 2024-09-15T12:18:30.382 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 2 2024-09-15T12:18:30.382 INFO:tasks.workunit.client.0.smithi071.stdout:snap: snap1-rename 2024-09-15T12:18:30.382 INFO:tasks.workunit.client.0.smithi071.stdout:snap: snap2 2024-09-15T12:18:30.382 INFO:tasks.workunit.client.0.smithi071.stdout:found snap1-rename with size 2097152 2024-09-15T12:18:30.382 INFO:tasks.workunit.client.0.smithi071.stdout:found snap2 with size 4194304 2024-09-15T12:18:31.384 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 1 2024-09-15T12:18:31.385 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 1 2024-09-15T12:18:31.385 INFO:tasks.workunit.client.0.smithi071.stdout:snap: snap2-rename 2024-09-15T12:18:31.385 INFO:tasks.workunit.client.0.smithi071.stdout:found snap2-rename with size 4194304 2024-09-15T12:18:32.337 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 0 2024-09-15T12:18:32.338 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 0 2024-09-15T12:18:32.354 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCreateLsRenameSnapPP (4041 ms) 2024-09-15T12:18:32.354 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ConcurrentCreatesUnvalidatedPool 2024-09-15T12:18:34.167 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:18:34.167 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:18:34.167 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:18:34.167 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:18:36.998 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.ConcurrentCreatesUnvalidatedPool (4644 ms) 2024-09-15T12:18:36.998 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.RemoveFullTry 2024-09-15T12:18:41.435 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:19:13.625 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.RemoveFullTry (36627 ms) 2024-09-15T12:19:13.626 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.RemoveFullTryDataPool 2024-09-15T12:19:13.626 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2227: Skipped 2024-09-15T12:19:13.626 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:19:13.626 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryDataPool (0 ms) 2024-09-15T12:19:13.626 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespace 2024-09-15T12:19:13.626 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2247: Skipped 2024-09-15T12:19:13.626 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:19:13.626 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespace (0 ms) 2024-09-15T12:19:13.626 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespaceDataPool 2024-09-15T12:19:13.627 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2269: Skipped 2024-09-15T12:19:13.627 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:19:13.627 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespaceDataPool (0 ms) 2024-09-15T12:19:13.627 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestIO 2024-09-15T12:19:13.627 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:19:44.174 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:19:44.175 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:19:44.175 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:19:44.175 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:19:44.175 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:19:44.175 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.175 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:19:44.175 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.175 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.175 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:19:44.176 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.176 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:19:44.176 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.176 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.176 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:19:44.176 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.176 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:19:44.176 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.176 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.176 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:19:44.176 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.176 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:19:44.176 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.176 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.177 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:19:44.177 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.177 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:19:44.177 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.177 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.177 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:19:44.177 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:19:44.177 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:19:44.177 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:19:44.177 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:19:44.177 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:19:44.177 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:19:44.177 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:19:44.177 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:19:44.177 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:19:44.178 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:19:44.178 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.178 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:19:44.178 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.178 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.178 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:19:44.178 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.178 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:19:44.178 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.178 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.178 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:19:44.178 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.178 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:19:44.178 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.178 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.179 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:19:44.179 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.179 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:19:44.179 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.179 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.179 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:19:44.179 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.179 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:19:44.179 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.179 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.179 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:19:44.179 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:19:44.179 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:19:44.179 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.180 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:19:44.181 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:19:44.181 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:19:44.181 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.181 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:19:44.181 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:19:44.181 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:19:44.181 INFO:tasks.workunit.client.0.smithi071.stdout:discard: 512~512 = 512 2024-09-15T12:19:44.181 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.181 INFO:tasks.workunit.client.0.smithi071.stdout:aio discard: 1536~512 = 0 2024-09-15T12:19:44.181 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:19:44.181 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:19:44.181 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:19:44.181 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:19:44.181 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 0 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 0 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 16384 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 16384 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 49152 2024-09-15T12:19:44.182 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.183 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.183 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 49152 2024-09-15T12:19:44.183 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.183 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.183 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 65536 2024-09-15T12:19:44.183 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.183 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.183 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 65536 2024-09-15T12:19:44.183 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.183 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.183 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:19:44.183 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:19:44.183 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 98304 2024-09-15T12:19:44.183 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.184 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.184 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 98304 2024-09-15T12:19:44.184 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.184 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.184 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 114688 2024-09-15T12:19:44.184 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.184 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.184 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 114688 2024-09-15T12:19:44.184 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.184 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.184 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:19:44.184 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:19:44.184 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 147456 2024-09-15T12:19:44.184 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.185 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.185 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 147456 2024-09-15T12:19:44.185 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.185 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.185 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 163840 2024-09-15T12:19:44.185 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.185 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.185 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 163840 2024-09-15T12:19:44.185 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.185 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.185 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:19:44.185 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:19:44.185 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 196608 2024-09-15T12:19:44.185 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.185 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 196608 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 212992 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 212992 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.186 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.187 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.188 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.188 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:19:44.188 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.188 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.188 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:19:44.188 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.188 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.188 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.188 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:19:44.188 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:19:44.188 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.188 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:19:44.188 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:19:44.188 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.188 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:19:44.189 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.189 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.189 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:19:44.189 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.189 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.189 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:19:44.189 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:19:44.189 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:19:44.189 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:19:44.189 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:19:44.189 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:19:44.189 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:19:44.189 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.175 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.175 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:10.175 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:10.175 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:10.175 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:10.175 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:10.176 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.176 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.176 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:10.176 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:10.176 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:10.176 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:10.176 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:10.176 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.176 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.176 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:10.176 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.176 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.176 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:10.177 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.177 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.177 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:10.177 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:10.177 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:10.177 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:10.177 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:10.177 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.177 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.177 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:10.177 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:10.177 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:10.177 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:10.180 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.180 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.180 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:10.180 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:10.180 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:10.180 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:10.180 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:10.180 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.180 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.180 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:10.180 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:10.180 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:10.180 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:10.180 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:10.184 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:10.184 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:10.184 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:10.184 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:20:10.184 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:20:10.184 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:20:10.184 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:20:10.184 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestIO (56550 ms) 2024-09-15T12:20:10.184 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS1 2024-09-15T12:20:10.184 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:20:49.654 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:20:49.654 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:20:49.654 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:20:49.654 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:20:49.654 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:20:49.654 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.654 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:20:49.654 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.654 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.655 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:20:49.655 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.655 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:20:49.655 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.655 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.655 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:20:49.655 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.655 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:20:49.655 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.655 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.655 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:20:49.655 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.655 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:20:49.656 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.656 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.656 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:20:49.656 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.656 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:20:49.656 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.656 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.656 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:20:49.656 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:20:49.656 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:20:49.656 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:20:49.656 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:20:49.656 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:20:49.656 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:20:49.657 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:20:49.657 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:20:49.657 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:20:49.657 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:20:49.657 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.657 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:20:49.657 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.657 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.657 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:20:49.657 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.657 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:20:49.657 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.657 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.657 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:20:49.657 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.658 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:20:49.658 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.658 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.658 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:20:49.658 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.658 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:20:49.658 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.658 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.658 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:20:49.658 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.658 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:20:49.658 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.658 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.658 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:20:49.658 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:20:49.659 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:20:49.659 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:20:49.659 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:20:49.659 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:20:49.659 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.659 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:20:49.659 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:20:49.659 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:20:49.659 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.659 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:20:49.659 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:20:49.659 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:20:49.659 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.659 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:20:49.660 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:20:49.660 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:20:49.660 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.660 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:20:49.660 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:20:49.660 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:20:49.660 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.660 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:20:49.660 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:20:49.660 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:20:49.660 INFO:tasks.workunit.client.0.smithi071.stdout:discard: 512~512 = 512 2024-09-15T12:20:49.660 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.660 INFO:tasks.workunit.client.0.smithi071.stdout:aio discard: 1536~512 = 0 2024-09-15T12:20:49.661 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:20:49.661 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:20:49.661 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:20:49.661 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:20:49.661 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:20:49.661 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 0 2024-09-15T12:20:49.661 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.661 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.661 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 0 2024-09-15T12:20:49.661 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.661 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.661 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 16384 2024-09-15T12:20:49.661 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.662 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.662 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 16384 2024-09-15T12:20:49.662 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.662 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.662 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:49.662 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:49.662 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 49152 2024-09-15T12:20:49.662 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.662 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.662 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 49152 2024-09-15T12:20:49.662 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.662 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.662 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 65536 2024-09-15T12:20:49.663 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.663 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.663 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 65536 2024-09-15T12:20:49.663 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.663 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.663 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:49.663 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:49.663 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 98304 2024-09-15T12:20:49.663 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.663 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.663 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 98304 2024-09-15T12:20:49.663 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.663 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.663 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 114688 2024-09-15T12:20:49.664 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.664 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.664 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 114688 2024-09-15T12:20:49.664 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.664 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.664 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:49.664 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:49.664 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 147456 2024-09-15T12:20:49.664 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.664 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.664 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 147456 2024-09-15T12:20:49.664 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.664 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.664 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 163840 2024-09-15T12:20:49.664 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.665 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.665 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 163840 2024-09-15T12:20:49.665 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.665 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.665 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:49.665 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:49.665 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 196608 2024-09-15T12:20:49.665 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.665 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.665 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 196608 2024-09-15T12:20:49.665 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.665 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.665 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 212992 2024-09-15T12:20:49.666 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.666 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.666 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 212992 2024-09-15T12:20:49.666 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.666 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.666 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:49.666 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:49.666 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.666 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:49.666 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.666 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.666 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:49.666 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.666 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.666 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.667 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:49.667 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.667 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.667 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:49.667 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.667 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.667 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.667 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:49.667 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.667 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.667 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:49.667 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.667 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.667 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.668 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:49.668 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.668 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.668 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:49.668 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.668 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.668 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.668 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:49.668 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:49.668 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.668 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:49.668 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:20:49.668 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.668 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:49.669 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.669 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.669 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:49.669 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.669 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.669 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:20:49.669 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:20:49.669 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:20:49.669 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:20:49.669 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:20:49.669 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:20:49.669 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:20:49.669 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.427 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.427 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:21:25.427 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:21:25.427 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:21:25.427 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:21:25.427 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:21:25.427 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.427 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.427 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:21:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:21:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:21:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:21:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:21:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:21:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:21:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:21:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:21:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:21:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:21:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:21:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:21:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:21:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:21:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:21:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:21:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.430 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.430 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:21:25.430 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:21:25.430 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:21:25.430 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:21:25.430 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:21:25.430 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.430 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.430 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:21:25.430 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:21:25.430 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:21:25.430 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:21:25.430 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:21:25.430 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.431 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.431 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:21:25.431 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.431 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.431 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:21:25.431 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.431 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.431 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:21:25.431 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:21:25.431 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:21:25.431 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:21:25.431 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:21:25.431 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.432 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.432 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:21:25.432 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:21:25.432 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:21:25.432 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:21:25.432 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:21:25.432 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.432 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.432 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:21:25.432 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:21:25.432 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:21:25.432 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:21:25.432 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:21:25.432 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.432 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.433 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:21:25.433 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:21:25.433 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:21:25.433 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:21:25.433 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:21:25.433 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.433 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.433 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:21:25.433 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.433 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.433 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:21:25.433 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.433 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.433 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:21:25.433 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:21:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:21:25.435 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:21:25.435 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.435 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.435 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:21:25.435 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:21:25.435 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:21:25.435 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:21:25.435 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:21:25.435 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.435 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.435 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:21:25.435 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:21:25.435 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:21:25.436 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:21:25.436 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:21:25.436 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:21:25.436 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:21:25.436 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:21:25.436 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 4 2024-09-15T12:21:25.436 INFO:tasks.workunit.client.0.smithi071.stdout:read: 4 2024-09-15T12:21:25.436 INFO:tasks.workunit.client.0.smithi071.stdout:read: 4 2024-09-15T12:21:25.436 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS1 (75252 ms) 2024-09-15T12:21:25.436 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS2 2024-09-15T12:21:25.436 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:22:08.854 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:22:08.854 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:22:08.855 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:22:08.855 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:22:08.855 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:22:08.855 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.855 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:22:08.855 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.855 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.855 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:22:08.855 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.855 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:22:08.855 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.855 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.855 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:22:08.856 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.856 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:22:08.856 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.856 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.856 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:22:08.856 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.856 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:22:08.856 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.856 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.856 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:22:08.856 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.856 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:22:08.856 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.856 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.857 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:22:08.857 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:22:08.857 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:22:08.857 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:22:08.857 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:22:08.857 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:22:08.857 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:22:08.857 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:22:08.858 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:22:08.858 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:22:08.858 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:22:08.858 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.858 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:22:08.858 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.858 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.858 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:22:08.858 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.858 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:22:08.858 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.859 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.859 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:22:08.859 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.859 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:22:08.859 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.859 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.859 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:22:08.859 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.859 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:22:08.859 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.859 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.860 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:22:08.860 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.860 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:22:08.860 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.860 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.860 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:22:08.860 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:22:08.860 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:22:08.860 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:22:08.860 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:22:08.860 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:22:08.860 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.861 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:22:08.861 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:22:08.861 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:22:08.861 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.861 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:22:08.862 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:22:08.862 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:22:08.862 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.862 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:22:08.862 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:22:08.862 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:22:08.863 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.863 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:22:08.863 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:22:08.863 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:22:08.863 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.863 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:22:08.864 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:22:08.864 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:22:08.864 INFO:tasks.workunit.client.0.smithi071.stdout:discard: 512~512 = 512 2024-09-15T12:22:08.864 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.864 INFO:tasks.workunit.client.0.smithi071.stdout:aio discard: 1536~512 = 0 2024-09-15T12:22:08.864 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:22:08.864 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:22:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:22:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:22:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:22:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 0 2024-09-15T12:22:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 0 2024-09-15T12:22:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 16384 2024-09-15T12:22:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 16384 2024-09-15T12:22:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.866 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:08.866 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:08.866 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 49152 2024-09-15T12:22:08.866 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.866 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.866 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 49152 2024-09-15T12:22:08.866 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.866 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.866 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 65536 2024-09-15T12:22:08.866 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.867 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.867 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 65536 2024-09-15T12:22:08.867 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.867 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.867 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:08.867 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:08.867 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 98304 2024-09-15T12:22:08.867 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.867 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.867 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 98304 2024-09-15T12:22:08.867 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.867 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.867 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 114688 2024-09-15T12:22:08.867 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.868 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.868 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 114688 2024-09-15T12:22:08.868 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.868 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.868 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:08.868 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:08.868 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 147456 2024-09-15T12:22:08.868 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.868 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.868 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 147456 2024-09-15T12:22:08.868 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.868 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.868 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 163840 2024-09-15T12:22:08.868 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.869 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.869 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 163840 2024-09-15T12:22:08.869 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.869 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.869 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:08.869 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:08.869 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 196608 2024-09-15T12:22:08.869 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.869 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.869 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 196608 2024-09-15T12:22:08.869 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.869 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.869 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 212992 2024-09-15T12:22:08.870 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.870 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.870 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 212992 2024-09-15T12:22:08.870 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.870 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.870 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:08.870 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:08.870 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.870 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:08.870 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.870 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.871 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:08.871 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.871 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.871 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.871 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:08.871 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.871 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.871 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:08.871 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.871 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.871 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.871 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:08.871 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.871 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.872 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:08.872 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.872 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.872 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.872 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:08.872 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.872 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.872 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:08.872 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.872 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.872 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.872 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:08.872 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:08.872 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.872 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:08.873 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:08.873 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.873 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:08.873 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.873 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.873 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:08.873 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.873 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.873 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:08.873 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:08.873 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:08.874 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:08.874 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:08.874 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:08.874 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:08.874 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.796 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.796 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:43.796 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:43.796 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:43.796 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:43.796 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:43.796 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.796 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.796 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:43.797 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:43.797 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:43.797 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:43.797 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:43.797 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.797 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.797 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:43.797 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.797 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.797 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:43.797 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.797 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.797 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:43.797 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:43.797 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:43.798 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:43.798 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:43.798 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.798 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.798 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:43.798 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:43.798 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:43.798 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:43.799 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:43.799 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.799 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.799 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:43.799 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:43.799 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:43.799 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:43.799 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:43.799 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.799 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.799 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:43.800 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:43.800 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:43.800 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:43.800 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:43.800 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.800 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.800 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:43.800 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.800 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.800 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:43.800 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.800 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.800 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:43.801 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:43.801 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:43.801 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:43.801 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:43.801 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.801 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.801 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:43.801 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:43.801 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:43.801 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:43.801 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:43.801 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.801 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.801 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:43.801 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:43.802 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:43.802 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:43.802 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:43.802 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.802 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.802 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:43.802 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:43.802 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:43.802 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:43.802 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:43.802 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.803 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.803 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:43.803 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.803 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.803 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:43.803 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.803 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.804 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:43.804 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:43.804 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:43.804 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:43.804 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:43.804 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.804 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.804 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:43.804 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:43.804 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:43.804 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:43.804 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:43.804 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.804 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.805 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:43.805 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:43.805 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:43.805 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:43.805 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:43.805 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.805 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.805 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:22:43.805 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:22:43.805 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:22:43.805 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:22:43.805 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:22:43.805 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.805 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.806 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:43.806 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:22:43.806 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:22:43.806 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:22:43.806 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:22:43.806 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:22:43.806 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:22:43.806 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:22:43.806 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 4 2024-09-15T12:22:43.806 INFO:tasks.workunit.client.0.smithi071.stdout:read: 4 2024-09-15T12:22:43.806 INFO:tasks.workunit.client.0.smithi071.stdout:read: 4 2024-09-15T12:22:43.806 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS2 (78368 ms) 2024-09-15T12:22:43.806 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCloneEncryption 2024-09-15T12:22:43.806 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2471: Skipped 2024-09-15T12:22:43.807 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:22:43.807 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestCloneEncryption (0 ms) 2024-09-15T12:22:43.807 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.LUKS1UnderLUKS2WithoutResize 2024-09-15T12:22:43.807 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2659: Skipped 2024-09-15T12:22:43.807 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:22:43.807 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.LUKS1UnderLUKS2WithoutResize (0 ms) 2024-09-15T12:22:43.807 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.LUKS2UnderLUKS1WithoutResize 2024-09-15T12:22:43.807 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2735: Skipped 2024-09-15T12:22:43.807 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:22:43.807 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.LUKS2UnderLUKS1WithoutResize (0 ms) 2024-09-15T12:22:43.807 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.EncryptionFormatNoData 2024-09-15T12:22:43.807 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:22:48.282 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.EncryptionFormatNoData (4487 ms) 2024-09-15T12:22:48.282 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadSize 2024-09-15T12:22:48.282 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:22:54.318 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.EncryptionLoadBadSize (6036 ms) 2024-09-15T12:22:54.318 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-15T12:22:54.319 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2905: Skipped 2024-09-15T12:22:54.319 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:22:54.319 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern (0 ms) 2024-09-15T12:22:54.319 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.EncryptionLoadFormatMismatch 2024-09-15T12:22:54.319 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2985: Skipped 2024-09-15T12:22:54.319 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:22:54.319 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadFormatMismatch (0 ms) 2024-09-15T12:22:54.319 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.EncryptedResize 2024-09-15T12:22:54.319 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:23:09.735 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.EncryptedResize (15417 ms) 2024-09-15T12:23:09.735 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.EncryptedFlattenSmallData 2024-09-15T12:23:09.735 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3202: Skipped 2024-09-15T12:23:09.735 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:23:09.735 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.EncryptedFlattenSmallData (0 ms) 2024-09-15T12:23:09.735 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestIOWithIOHint 2024-09-15T12:23:09.735 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:23:39.960 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:23:39.960 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:23:39.960 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:23:39.960 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:23:39.960 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:23:39.960 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.960 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:23:39.961 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.961 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.961 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:23:39.961 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.961 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:23:39.961 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.961 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.961 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:23:39.961 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.961 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:23:39.961 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.961 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.961 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:23:39.962 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.962 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:23:39.962 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.962 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.962 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:23:39.962 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.962 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:23:39.962 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.962 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.962 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:23:39.962 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:23:39.962 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:23:39.962 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:23:39.963 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:23:39.963 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:23:39.963 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:23:39.963 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:23:39.963 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:23:39.963 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:23:39.963 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:23:39.963 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.963 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:23:39.963 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.963 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.963 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:23:39.963 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.963 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:23:39.964 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.964 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.964 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:23:39.964 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.964 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:23:39.964 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.964 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.964 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:23:39.964 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.964 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:23:39.964 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.964 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.964 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:23:39.964 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.965 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:23:39.965 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.965 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.965 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:23:39.965 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:23:39.965 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:23:39.965 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:23:39.965 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:23:39.965 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:23:39.965 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.965 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:23:39.965 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:23:39.965 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:23:39.966 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.966 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:23:39.966 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:23:39.966 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:23:39.966 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.966 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:23:39.966 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:23:39.966 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:23:39.966 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.966 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:23:39.966 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:23:39.966 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:23:39.966 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.966 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:23:39.966 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:23:39.967 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:23:39.967 INFO:tasks.workunit.client.0.smithi071.stdout:discard: 512~512 = 512 2024-09-15T12:23:39.967 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.967 INFO:tasks.workunit.client.0.smithi071.stdout:aio discard: 1536~512 = 0 2024-09-15T12:23:39.967 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:23:39.967 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:23:39.967 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:23:39.967 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:23:39.967 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:23:39.967 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 0 2024-09-15T12:23:39.967 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.967 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.967 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 0 2024-09-15T12:23:39.968 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.968 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.968 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 16384 2024-09-15T12:23:39.968 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.968 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.968 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 16384 2024-09-15T12:23:39.968 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.968 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.968 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:23:39.968 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:23:39.968 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 49152 2024-09-15T12:23:39.968 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.968 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.968 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 49152 2024-09-15T12:23:39.969 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.969 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.969 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 65536 2024-09-15T12:23:39.969 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.969 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.969 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 65536 2024-09-15T12:23:39.969 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.969 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.969 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:23:39.969 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:23:39.969 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 98304 2024-09-15T12:23:39.969 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.969 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.970 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 98304 2024-09-15T12:23:39.970 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.970 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.970 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 114688 2024-09-15T12:23:39.970 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.970 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.970 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 114688 2024-09-15T12:23:39.970 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.970 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.970 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:23:39.970 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:23:39.970 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 147456 2024-09-15T12:23:39.970 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.970 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.971 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 147456 2024-09-15T12:23:39.971 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.971 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.971 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 163840 2024-09-15T12:23:39.971 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.971 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.971 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 163840 2024-09-15T12:23:39.971 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.971 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.971 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:23:39.971 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:23:39.971 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 196608 2024-09-15T12:23:39.971 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.971 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.972 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 196608 2024-09-15T12:23:39.972 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.972 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.972 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 212992 2024-09-15T12:23:39.972 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.972 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.972 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 212992 2024-09-15T12:23:39.972 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.972 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.972 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:23:39.972 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:23:39.972 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.972 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:23:39.972 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.973 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.973 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:23:39.973 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.973 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.973 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.973 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:23:39.973 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.973 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.973 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:23:39.973 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.973 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.973 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.973 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:23:39.974 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.974 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.974 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:23:39.974 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.974 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.974 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.974 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:23:39.974 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.974 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.974 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:23:39.974 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.974 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.974 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.974 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:23:39.975 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:23:39.975 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.975 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:23:39.975 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:23:39.975 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.975 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:23:39.975 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.975 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.975 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:23:39.975 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.975 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.975 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:23:39.975 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:23:39.975 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:23:39.976 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:23:39.976 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:23:39.976 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:23:39.976 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:23:39.976 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.880 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.880 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:05.880 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:05.880 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:05.880 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:05.880 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:05.881 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.881 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.881 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:05.881 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:05.881 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:05.881 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:05.881 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:05.881 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.881 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.881 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:05.881 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.881 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.881 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:05.881 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.882 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.882 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:05.882 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:05.882 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:05.882 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:05.882 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:05.882 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.882 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.882 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:05.882 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:05.882 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:05.882 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:05.882 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:05.882 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.883 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.883 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:05.883 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:05.883 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:05.883 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:05.883 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:05.883 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.883 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.883 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:05.883 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:05.883 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:05.883 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:05.883 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:05.883 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.883 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.884 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:05.884 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.884 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.884 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:05.884 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.884 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.884 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:05.884 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:05.884 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:05.884 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:05.884 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:05.884 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.884 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.885 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:05.885 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:05.885 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:05.885 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:05.885 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:05.885 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.885 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.885 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:05.885 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:05.885 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:05.885 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:05.885 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:05.885 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.885 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.885 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:05.886 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:05.886 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:05.886 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:05.886 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:05.886 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.886 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.886 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:05.886 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.886 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.886 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:05.886 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.886 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.886 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:05.887 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:05.887 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:05.887 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:05.887 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:05.887 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.887 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.887 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:05.887 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:05.887 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:05.887 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:05.887 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:05.887 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.887 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.887 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:05.888 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:05.888 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:05.888 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:05.888 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:05.888 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.888 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.888 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:05.888 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:05.888 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:05.889 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:05.889 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:05.889 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.889 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.889 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:05.889 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:05.889 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:05.889 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:05.889 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:24:05.889 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:24:05.889 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:24:05.889 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestIOWithIOHint (56145 ms) 2024-09-15T12:24:05.889 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestDataPoolIO 2024-09-15T12:24:05.889 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3947: Skipped 2024-09-15T12:24:05.890 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:24:05.890 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestDataPoolIO (0 ms) 2024-09-15T12:24:05.890 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatch 2024-09-15T12:24:05.890 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:06.045 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatch (165 ms) 2024-09-15T12:24:06.045 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatch 2024-09-15T12:24:06.045 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:06.234 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatch (190 ms) 2024-09-15T12:24:06.234 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccess 2024-09-15T12:24:06.234 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:06.431 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccess (196 ms) 2024-09-15T12:24:06.431 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccess 2024-09-15T12:24:06.431 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:06.625 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccess (195 ms) 2024-09-15T12:24:06.626 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned 2024-09-15T12:24:06.626 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:07.054 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned (428 ms) 2024-09-15T12:24:07.054 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned 2024-09-15T12:24:07.054 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:07.802 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned (748 ms) 2024-09-15T12:24:07.802 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLarge 2024-09-15T12:24:07.802 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:08.283 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLarge (481 ms) 2024-09-15T12:24:08.283 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLarge 2024-09-15T12:24:08.283 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:08.931 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLarge (648 ms) 2024-09-15T12:24:08.931 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess 2024-09-15T12:24:08.931 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:13.472 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess (4541 ms) 2024-09-15T12:24:13.472 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess 2024-09-15T12:24:13.472 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:17.531 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess (4059 ms) 2024-09-15T12:24:17.531 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers 2024-09-15T12:24:17.531 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:17.685 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers (155 ms) 2024-09-15T12:24:17.685 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVMismatch 2024-09-15T12:24:17.685 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:17.856 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVMismatch (171 ms) 2024-09-15T12:24:17.856 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVSuccess 2024-09-15T12:24:17.857 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:18.024 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVSuccess (168 ms) 2024-09-15T12:24:18.024 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestScatterGatherIO 2024-09-15T12:24:18.025 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:18.196 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestScatterGatherIO (172 ms) 2024-09-15T12:24:18.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestEmptyDiscard 2024-09-15T12:24:18.197 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:18.437 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:18.437 INFO:tasks.workunit.client.0.smithi071.stdout:aio discard: 0~1048576 = 0 2024-09-15T12:24:18.437 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:18.437 INFO:tasks.workunit.client.0.smithi071.stdout:aio discard: 0~4194304 = 0 2024-09-15T12:24:18.437 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:18.437 INFO:tasks.workunit.client.0.smithi071.stdout:aio discard: 3145728~1048576 = 0 2024-09-15T12:24:18.437 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestEmptyDiscard (240 ms) 2024-09-15T12:24:18.437 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestFUA 2024-09-15T12:24:18.437 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:19.165 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:24:19.165 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:24:19.165 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:24:19.165 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:24:19.165 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:24:19.165 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:24:19.165 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:24:19.165 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:24:19.166 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:24:19.166 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:24:19.166 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.166 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:24:19.166 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:19.166 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:19.166 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:24:19.166 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.166 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:24:19.166 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:19.166 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:19.166 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:24:19.166 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.167 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:24:19.167 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:19.167 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:19.167 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:24:19.167 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.167 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:24:19.167 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:19.167 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:19.167 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:24:19.167 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.167 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:24:19.167 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:19.167 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:19.167 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:24:19.168 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.168 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:24:19.168 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:24:19.168 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:24:19.168 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.168 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:24:19.168 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:24:19.168 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:24:19.168 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.168 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:24:19.168 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:24:19.168 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:24:19.168 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.169 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:24:19.169 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:24:19.169 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:24:19.169 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.169 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:24:19.169 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:24:19.169 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:24:19.169 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestFUA (728 ms) 2024-09-15T12:24:19.169 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestIOPP 2024-09-15T12:24:19.169 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:24:19.258 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:24:19.258 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:24:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:24:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:24:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:24:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:24:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:24:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:24:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:24:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:24:19.260 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:19.260 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:19.260 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:24:19.260 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.260 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:24:19.260 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:19.260 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:19.260 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:24:19.260 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.260 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:24:19.260 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:19.500 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:19.500 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:24:19.500 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:24:19.500 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:24:19.501 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:24:19.501 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:24:19.501 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:24:19.501 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:24:19.501 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:24:19.501 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:24:19.501 INFO:tasks.workunit.client.0.smithi071.stdout:start compare and write 2024-09-15T12:24:19.501 INFO:tasks.workunit.client.0.smithi071.stdout:compare and wrote: 512 2024-09-15T12:24:19.501 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.501 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:24:19.501 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:19.519 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:19.519 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:24:19.519 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.519 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:24:19.519 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:19.538 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:19.538 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:24:19.538 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.538 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:24:19.538 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:19.557 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:19.557 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:24:19.557 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.557 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:24:19.557 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:19.575 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:19.575 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:24:19.575 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.576 INFO:tasks.workunit.client.0.smithi071.stdout:started aio compare and write 2024-09-15T12:24:19.576 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:19.618 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:19.618 INFO:tasks.workunit.client.0.smithi071.stdout:finished aio compare and write 2024-09-15T12:24:19.618 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:24:19.618 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:24:19.618 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:24:19.618 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:24:19.618 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:24:19.618 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.618 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:24:19.618 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:24:19.624 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:24:19.624 INFO:tasks.workunit.client.0.smithi071.stdout:finished read 2024-09-15T12:24:19.624 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.624 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:24:19.624 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:24:19.629 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:24:19.629 INFO:tasks.workunit.client.0.smithi071.stdout:finished read 2024-09-15T12:24:19.630 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.630 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:24:19.630 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:24:19.635 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:24:19.635 INFO:tasks.workunit.client.0.smithi071.stdout:finished read 2024-09-15T12:24:19.635 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.636 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:24:19.636 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:24:19.641 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:24:19.642 INFO:tasks.workunit.client.0.smithi071.stdout:finished read 2024-09-15T12:24:19.642 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:19.642 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:24:19.642 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:24:19.642 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:24:19.642 INFO:tasks.workunit.client.0.smithi071.stdout:finished read 2024-09-15T12:24:19.642 INFO:tasks.workunit.client.0.smithi071.stdout:discard: 512~512 2024-09-15T12:24:19.642 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:42.385 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:24:42.385 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:24:42.385 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:24:42.385 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:24:42.385 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:24:42.385 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 0 2024-09-15T12:24:42.385 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.386 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.386 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 0 2024-09-15T12:24:42.386 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.386 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.386 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 16384 2024-09-15T12:24:42.386 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.386 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.386 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 16384 2024-09-15T12:24:42.386 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.386 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.386 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:42.386 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:42.386 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 49152 2024-09-15T12:24:42.386 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 49152 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 65536 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 65536 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 98304 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.387 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 98304 2024-09-15T12:24:42.388 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.388 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.388 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 114688 2024-09-15T12:24:42.388 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.388 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.388 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 114688 2024-09-15T12:24:42.388 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.388 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.388 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:42.388 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:42.388 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 147456 2024-09-15T12:24:42.388 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.388 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.389 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 147456 2024-09-15T12:24:42.389 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.389 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.389 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 163840 2024-09-15T12:24:42.389 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.389 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.389 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 163840 2024-09-15T12:24:42.389 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.389 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.389 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:42.389 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:42.389 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 196608 2024-09-15T12:24:42.389 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.389 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.390 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 196608 2024-09-15T12:24:42.390 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.390 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.390 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 212992 2024-09-15T12:24:42.390 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.390 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.390 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 212992 2024-09-15T12:24:42.390 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.390 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.390 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:42.390 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:42.390 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:42.390 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:42.390 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:42.391 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:42.391 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:42.391 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.391 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.391 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:42.391 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:42.391 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:42.391 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:42.391 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:42.391 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.391 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.391 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:42.391 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:42.391 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:42.662 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:42.662 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:42.662 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.662 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.662 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:42.662 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:42.662 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:42.828 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:42.828 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:42.828 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:42.829 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:42.829 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:42.829 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:42.829 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:42.829 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:42.829 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:42.829 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:42.829 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:42.829 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:42.829 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:43.458 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:43.459 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:43.459 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:43.459 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:43.459 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:43.459 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:43.459 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:43.875 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:43.876 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:43.876 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:43.876 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:43.876 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:43.876 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:43.876 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:44.678 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:44.678 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:44.678 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:44.678 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:44.678 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:44.679 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:44.679 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:45.238 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:45.238 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:45.238 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:45.239 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:45.239 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:45.239 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:45.239 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:45.239 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:45.239 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:45.239 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:45.239 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:45.239 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:45.239 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:46.578 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:46.578 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:46.579 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:46.579 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:46.579 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:46.579 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:46.579 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:47.421 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:47.421 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:47.421 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:47.421 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:47.421 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:47.421 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:47.422 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:48.809 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:48.809 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:48.809 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:48.809 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:48.809 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:48.809 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:48.809 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:49.841 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:49.841 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:49.842 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:49.842 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:49.842 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:49.842 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:49.842 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:49.842 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:49.842 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:49.842 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:49.842 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:49.842 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:49.842 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:51.815 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:51.815 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:51.815 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:51.815 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:51.815 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:51.816 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:51.816 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:53.051 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:53.051 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:53.051 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:53.051 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:53.051 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:53.052 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:53.052 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:55.205 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:55.205 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:55.205 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:55.205 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:55.205 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:55.205 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:55.205 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:56.555 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:56.555 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:56.555 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:56.556 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:56.556 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:56.556 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:56.556 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:56.556 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:56.556 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:56.556 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:24:56.556 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:56.556 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:56.556 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:24:59.100 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:24:59.100 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:24:59.100 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:24:59.100 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:24:59.100 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:24:59.100 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:24:59.100 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:00.721 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:00.721 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:00.722 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:00.722 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:00.722 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:00.722 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:00.722 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:03.470 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:03.470 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:03.470 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:03.470 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:03.470 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:03.470 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:03.470 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:05.272 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:05.272 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:05.272 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:05.272 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:05.272 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:05.273 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:05.273 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:05.273 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:05.273 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:05.273 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:05.273 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestIOPP (46107 ms) 2024-09-15T12:25:05.273 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP 2024-09-15T12:25:05.273 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:05.408 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP (136 ms) 2024-09-15T12:25:05.408 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP 2024-09-15T12:25:05.408 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:05.558 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP (150 ms) 2024-09-15T12:25:05.558 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP 2024-09-15T12:25:05.558 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:05.702 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP (144 ms) 2024-09-15T12:25:05.702 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP 2024-09-15T12:25:05.703 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:05.852 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP (151 ms) 2024-09-15T12:25:05.853 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchPP 2024-09-15T12:25:05.853 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:06.016 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchPP (163 ms) 2024-09-15T12:25:06.016 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchPP 2024-09-15T12:25:06.016 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:06.152 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:06.185 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchPP (169 ms) 2024-09-15T12:25:06.185 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-15T12:25:06.185 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:06.382 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP (197 ms) 2024-09-15T12:25:06.382 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-15T12:25:06.382 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:06.561 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:06.605 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP (223 ms) 2024-09-15T12:25:06.605 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessPP 2024-09-15T12:25:06.606 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:06.813 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessPP (208 ms) 2024-09-15T12:25:06.813 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessPP 2024-09-15T12:25:06.813 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:06.966 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:06.998 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessPP (184 ms) 2024-09-15T12:25:06.998 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-15T12:25:06.998 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:07.193 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP (195 ms) 2024-09-15T12:25:07.193 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-15T12:25:07.193 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:07.344 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:07.380 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP (188 ms) 2024-09-15T12:25:07.380 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP 2024-09-15T12:25:07.381 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:07.970 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP (589 ms) 2024-09-15T12:25:07.970 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP 2024-09-15T12:25:07.970 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:08.208 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:08.575 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP (605 ms) 2024-09-15T12:25:08.575 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLargePP 2024-09-15T12:25:08.576 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:09.040 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLargePP (465 ms) 2024-09-15T12:25:09.040 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLargePP 2024-09-15T12:25:09.040 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:09.261 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:09.588 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLargePP (548 ms) 2024-09-15T12:25:09.588 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP 2024-09-15T12:25:09.588 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:13.918 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP (4330 ms) 2024-09-15T12:25:13.918 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP 2024-09-15T12:25:13.918 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:18.084 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:18.477 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP (4560 ms) 2024-09-15T12:25:18.478 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestIOPPWithIOHint 2024-09-15T12:25:18.478 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:25:18.702 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:25:18.702 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:25:18.702 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:25:18.702 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:25:18.702 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:25:18.702 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:18.702 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:25:18.702 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:18.732 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:18.732 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:25:18.732 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:18.732 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:25:18.732 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:18.749 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:18.749 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:25:18.749 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:18.749 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:25:18.749 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:18.765 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:18.765 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:25:18.766 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:18.766 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:25:18.766 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:18.786 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:18.787 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:25:18.787 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:18.787 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:25:18.787 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:18.816 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:18.816 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:25:18.816 INFO:tasks.workunit.client.0.smithi071.stdout:read: 512 2024-09-15T12:25:18.816 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:18.816 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:25:18.816 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:25:18.825 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:25:18.825 INFO:tasks.workunit.client.0.smithi071.stdout:finished read 2024-09-15T12:25:18.825 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:18.825 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:25:18.825 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:25:18.831 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:25:18.831 INFO:tasks.workunit.client.0.smithi071.stdout:finished read 2024-09-15T12:25:18.831 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:18.831 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:25:18.831 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:25:18.836 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:25:18.836 INFO:tasks.workunit.client.0.smithi071.stdout:finished read 2024-09-15T12:25:18.836 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:18.836 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:25:18.837 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:25:18.843 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:25:18.844 INFO:tasks.workunit.client.0.smithi071.stdout:finished read 2024-09-15T12:25:18.844 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:18.844 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:25:18.844 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:25:39.374 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:25:39.375 INFO:tasks.workunit.client.0.smithi071.stdout:finished read 2024-09-15T12:25:39.375 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 0 2024-09-15T12:25:39.375 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.375 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.375 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 0 2024-09-15T12:25:39.375 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.375 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.375 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 16384 2024-09-15T12:25:39.375 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.375 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.376 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 16384 2024-09-15T12:25:39.376 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.376 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.376 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:39.376 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:39.376 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 49152 2024-09-15T12:25:39.376 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.376 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.376 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 49152 2024-09-15T12:25:39.376 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.376 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.376 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 65536 2024-09-15T12:25:39.376 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.377 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.377 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 65536 2024-09-15T12:25:39.377 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.377 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.377 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:39.377 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:39.377 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 98304 2024-09-15T12:25:39.377 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.377 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.377 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 98304 2024-09-15T12:25:39.377 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.377 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.377 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 114688 2024-09-15T12:25:39.378 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.378 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.378 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 114688 2024-09-15T12:25:39.378 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.378 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.378 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:39.378 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:39.378 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 147456 2024-09-15T12:25:39.378 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.378 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.378 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 147456 2024-09-15T12:25:39.378 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.379 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.379 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 163840 2024-09-15T12:25:39.379 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.379 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.379 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 163840 2024-09-15T12:25:39.379 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.379 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.379 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:39.379 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:39.379 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 196608 2024-09-15T12:25:39.379 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.379 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.379 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 196608 2024-09-15T12:25:39.379 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.379 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.380 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 212992 2024-09-15T12:25:39.380 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.380 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.380 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 212992 2024-09-15T12:25:39.380 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.380 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.380 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:39.380 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:39.380 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:39.380 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:39.380 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:39.380 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:39.380 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:39.381 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.381 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.381 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:39.381 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:39.381 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:39.580 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:39.581 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:39.581 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.581 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.581 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:39.581 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:39.581 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:39.711 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:39.711 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:39.712 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:39.712 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:39.712 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:39.712 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:39.712 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:39.712 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:39.712 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:39.712 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:39.712 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:39.712 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:39.712 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:40.256 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:40.257 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:40.257 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:40.257 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:40.257 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:40.257 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:40.257 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:40.617 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:40.618 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:40.618 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:40.618 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:40.618 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:40.618 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:40.618 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:41.410 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:41.411 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:41.411 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:41.411 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:41.411 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:41.411 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:41.411 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:42.072 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:42.073 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:42.073 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:42.073 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:42.073 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:42.073 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:42.073 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:42.073 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:42.073 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:42.073 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:42.073 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:42.073 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:42.073 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:43.261 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:43.262 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:43.262 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:43.262 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:43.262 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:43.262 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:43.262 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:43.953 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:43.953 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:43.954 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:43.954 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:43.954 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:43.954 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:43.954 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:45.193 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:45.193 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:45.193 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:45.194 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:45.194 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:45.194 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:45.194 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:46.060 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:46.060 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:46.060 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:46.060 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:46.060 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:46.060 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:46.060 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:46.060 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:46.061 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:46.061 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:46.061 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:46.061 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:46.061 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:47.806 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:47.806 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:47.806 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:47.806 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:47.806 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:47.806 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:47.806 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:48.877 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:48.878 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:48.878 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:48.878 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:48.878 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:48.878 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:48.878 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:50.993 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:50.993 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:50.993 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:50.993 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:50.993 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:50.994 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:50.994 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:52.139 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:52.139 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:52.140 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:52.140 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:52.140 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:52.140 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:52.140 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:52.140 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:52.140 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:52.140 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:25:52.140 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:52.140 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:52.140 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:54.375 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:54.375 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:54.375 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:54.375 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:54.375 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:54.375 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:54.375 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:55.891 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:55.891 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:55.891 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:55.891 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:55.891 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:55.891 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:55.891 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:25:58.479 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:25:58.479 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:25:58.479 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:25:58.479 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:25:58.480 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:25:58.480 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:25:58.480 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:26:00.051 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:26:00.052 INFO:tasks.workunit.client.0.smithi071.stdout:finished writesame 2024-09-15T12:26:00.052 INFO:tasks.workunit.client.0.smithi071.stdout:to verify the data 2024-09-15T12:26:00.052 INFO:tasks.workunit.client.0.smithi071.stdout:verified 2024-09-15T12:26:00.052 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:26:00.052 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:26:00.052 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:26:00.052 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:26:00.052 INFO:tasks.workunit.client.0.smithi071.stdout:started writesame 2024-09-15T12:26:00.052 INFO:tasks.workunit.client.0.smithi071.stdout:expected fail, finished writesame 2024-09-15T12:26:00.052 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestIOPPWithIOHint (41573 ms) 2024-09-15T12:26:00.053 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestIOToSnapshot 2024-09-15T12:26:00.053 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:02.468 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 0 2024-09-15T12:26:02.468 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 0 2024-09-15T12:26:02.468 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 1 2024-09-15T12:26:02.468 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 1 2024-09-15T12:26:02.468 INFO:tasks.workunit.client.0.smithi071.stdout:snap: orig 2024-09-15T12:26:02.468 INFO:tasks.workunit.client.0.smithi071.stdout:found orig with size 2097152 2024-09-15T12:26:02.468 INFO:tasks.workunit.client.0.smithi071.stdout:read: 80 2024-09-15T12:26:02.468 INFO:tasks.workunit.client.0.smithi071.stdout:write test data! 2024-09-15T12:26:02.468 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 80 2024-09-15T12:26:02.468 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 2 2024-09-15T12:26:02.468 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 2 2024-09-15T12:26:02.469 INFO:tasks.workunit.client.0.smithi071.stdout:snap: orig 2024-09-15T12:26:02.469 INFO:tasks.workunit.client.0.smithi071.stdout:snap: written 2024-09-15T12:26:02.469 INFO:tasks.workunit.client.0.smithi071.stdout:found orig with size 2097152 2024-09-15T12:26:02.469 INFO:tasks.workunit.client.0.smithi071.stdout:found written with size 2097152 2024-09-15T12:26:02.469 INFO:tasks.workunit.client.0.smithi071.stdout:read: 80 2024-09-15T12:26:02.469 INFO:tasks.workunit.client.0.smithi071.stdout:read: 80 2024-09-15T12:26:02.469 INFO:tasks.workunit.client.0.smithi071.stdout:read: 80 2024-09-15T12:26:02.469 INFO:tasks.workunit.client.0.smithi071.stdout:write to snapshot returned -30 2024-09-15T12:26:02.469 INFO:tasks.workunit.client.0.smithi071.stdout:Read-only file system 2024-09-15T12:26:02.624 INFO:tasks.workunit.client.0.smithi071.stdout:read: 80 2024-09-15T12:26:02.624 INFO:tasks.workunit.client.0.smithi071.stdout:read: 80 2024-09-15T12:26:02.624 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 80 2024-09-15T12:26:02.624 INFO:tasks.workunit.client.0.smithi071.stdout:opening testimg@orig 2024-09-15T12:26:02.624 INFO:tasks.workunit.client.0.smithi071.stdout:read: 80 2024-09-15T12:26:02.624 INFO:tasks.workunit.client.0.smithi071.stdout:write to snapshot returned -30 2024-09-15T12:26:02.624 INFO:tasks.workunit.client.0.smithi071.stdout:Read-only file system 2024-09-15T12:26:04.419 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 2 2024-09-15T12:26:04.419 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 2 2024-09-15T12:26:04.419 INFO:tasks.workunit.client.0.smithi071.stdout:snap: orig 2024-09-15T12:26:04.419 INFO:tasks.workunit.client.0.smithi071.stdout:snap: written 2024-09-15T12:26:04.419 INFO:tasks.workunit.client.0.smithi071.stdout:found orig with size 2097152 2024-09-15T12:26:04.419 INFO:tasks.workunit.client.0.smithi071.stdout:found written with size 2097152 2024-09-15T12:26:04.419 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 1 2024-09-15T12:26:04.420 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 1 2024-09-15T12:26:04.420 INFO:tasks.workunit.client.0.smithi071.stdout:snap: orig 2024-09-15T12:26:04.420 INFO:tasks.workunit.client.0.smithi071.stdout:found orig with size 2097152 2024-09-15T12:26:04.420 INFO:tasks.workunit.client.0.smithi071.stdout:num snaps is: 0 2024-09-15T12:26:04.420 INFO:tasks.workunit.client.0.smithi071.stdout:expected: 0 2024-09-15T12:26:04.420 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestIOToSnapshot (4368 ms) 2024-09-15T12:26:04.420 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestSnapshotDeletedIo 2024-09-15T12:26:04.420 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:06.415 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestSnapshotDeletedIo (1996 ms) 2024-09-15T12:26:06.415 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestClone 2024-09-15T12:26:06.415 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6444: Skipped 2024-09-15T12:26:06.415 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:06.415 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestClone (0 ms) 2024-09-15T12:26:06.415 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestClone2 2024-09-15T12:26:06.415 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6608: Skipped 2024-09-15T12:26:06.415 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:06.416 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestClone2 (0 ms) 2024-09-15T12:26:06.416 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ListChildren 2024-09-15T12:26:06.416 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6841: Skipped 2024-09-15T12:26:06.416 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:06.416 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ListChildren (0 ms) 2024-09-15T12:26:06.416 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ListChildrenTiered 2024-09-15T12:26:06.416 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6995: Skipped 2024-09-15T12:26:06.416 INFO:tasks.workunit.client.0.smithi071.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:26:06.416 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered (0 ms) 2024-09-15T12:26:06.416 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.LockingPP 2024-09-15T12:26:06.416 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:06.962 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.LockingPP (547 ms) 2024-09-15T12:26:06.962 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.FlushAio 2024-09-15T12:26:06.962 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:12.109 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.FlushAio (5147 ms) 2024-09-15T12:26:12.109 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.FlushAioPP 2024-09-15T12:26:12.109 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:15.787 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.FlushAioPP (3679 ms) 2024-09-15T12:26:15.788 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ZeroLengthWrite 2024-09-15T12:26:15.788 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:15.925 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.ZeroLengthWrite (137 ms) 2024-09-15T12:26:15.925 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ZeroLengthDiscard 2024-09-15T12:26:15.925 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:16.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.ZeroLengthDiscard (159 ms) 2024-09-15T12:26:16.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ZeroLengthRead 2024-09-15T12:26:16.084 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:16.215 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.ZeroLengthRead (131 ms) 2024-09-15T12:26:16.215 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.LargeCacheRead 2024-09-15T12:26:16.215 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:16.487 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.LargeCacheRead (272 ms) 2024-09-15T12:26:16.488 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestPendingAio 2024-09-15T12:26:16.488 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9152: Skipped 2024-09-15T12:26:16.488 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:16.488 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestPendingAio (0 ms) 2024-09-15T12:26:16.488 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyup 2024-09-15T12:26:16.488 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9264: Skipped 2024-09-15T12:26:16.488 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:16.488 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyup (0 ms) 2024-09-15T12:26:16.488 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-09-15T12:26:16.488 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9325: Skipped 2024-09-15T12:26:16.488 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:16.488 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyupMismatch (0 ms) 2024-09-15T12:26:16.489 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.Flatten 2024-09-15T12:26:16.489 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9336: Skipped 2024-09-15T12:26:16.489 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:16.489 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.Flatten (0 ms) 2024-09-15T12:26:16.489 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.Sparsify 2024-09-15T12:26:16.489 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:16.690 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 32768 2024-09-15T12:26:16.690 INFO:tasks.workunit.client.0.smithi071.stdout:read: 32768 2024-09-15T12:26:16.690 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.Sparsify (203 ms) 2024-09-15T12:26:16.690 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.SparsifyPP 2024-09-15T12:26:16.691 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:16.891 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.SparsifyPP (200 ms) 2024-09-15T12:26:16.891 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.SnapshotLimit 2024-09-15T12:26:16.891 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:22.068 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.SnapshotLimit (5177 ms) 2024-09-15T12:26:22.068 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.SnapshotLimitPP 2024-09-15T12:26:22.068 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:27.217 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.SnapshotLimitPP (5148 ms) 2024-09-15T12:26:27.217 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-09-15T12:26:27.217 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9523: Skipped 2024-09-15T12:26:27.217 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.217 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.RebuildObjectMapViaLockOwner (0 ms) 2024-09-15T12:26:27.217 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.RenameViaLockOwner 2024-09-15T12:26:27.218 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9575: Skipped 2024-09-15T12:26:27.218 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.218 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.RenameViaLockOwner (0 ms) 2024-09-15T12:26:27.218 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.SnapCreateViaLockOwner 2024-09-15T12:26:27.218 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9615: Skipped 2024-09-15T12:26:27.218 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.218 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SnapCreateViaLockOwner (0 ms) 2024-09-15T12:26:27.218 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.SnapRemoveViaLockOwner 2024-09-15T12:26:27.218 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9659: Skipped 2024-09-15T12:26:27.218 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.218 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveViaLockOwner (0 ms) 2024-09-15T12:26:27.218 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-09-15T12:26:27.219 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9699: Skipped 2024-09-15T12:26:27.219 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.219 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.UpdateFeaturesViaLockOwner (0 ms) 2024-09-15T12:26:27.219 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-15T12:26:27.219 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9736: Skipped 2024-09-15T12:26:27.219 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.219 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner (0 ms) 2024-09-15T12:26:27.219 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.SnapRemove2 2024-09-15T12:26:27.219 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9777: Skipped 2024-09-15T12:26:27.219 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.219 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SnapRemove2 (0 ms) 2024-09-15T12:26:27.219 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.SnapRenameViaLockOwner 2024-09-15T12:26:27.219 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9823: Skipped 2024-09-15T12:26:27.220 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.220 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SnapRenameViaLockOwner (0 ms) 2024-09-15T12:26:27.220 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.SnapProtectViaLockOwner 2024-09-15T12:26:27.220 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9864: Skipped 2024-09-15T12:26:27.220 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.220 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SnapProtectViaLockOwner (0 ms) 2024-09-15T12:26:27.220 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.SnapUnprotectViaLockOwner 2024-09-15T12:26:27.220 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9905: Skipped 2024-09-15T12:26:27.220 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.220 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SnapUnprotectViaLockOwner (0 ms) 2024-09-15T12:26:27.220 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.FlattenViaLockOwner 2024-09-15T12:26:27.220 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9949: Skipped 2024-09-15T12:26:27.220 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.220 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.FlattenViaLockOwner (0 ms) 2024-09-15T12:26:27.221 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ResizeViaLockOwner 2024-09-15T12:26:27.221 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9997: Skipped 2024-09-15T12:26:27.221 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.221 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ResizeViaLockOwner (0 ms) 2024-09-15T12:26:27.221 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.SparsifyViaLockOwner 2024-09-15T12:26:27.221 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10033: Skipped 2024-09-15T12:26:27.221 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.221 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SparsifyViaLockOwner (0 ms) 2024-09-15T12:26:27.221 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ObjectMapConsistentSnap 2024-09-15T12:26:27.221 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10069: Skipped 2024-09-15T12:26:27.221 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.221 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ObjectMapConsistentSnap (0 ms) 2024-09-15T12:26:27.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.Metadata 2024-09-15T12:26:27.222 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10121: Skipped 2024-09-15T12:26:27.222 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.Metadata (0 ms) 2024-09-15T12:26:27.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.MetadataPP 2024-09-15T12:26:27.222 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10310: Skipped 2024-09-15T12:26:27.222 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.MetadataPP (0 ms) 2024-09-15T12:26:27.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.UpdateFeatures 2024-09-15T12:26:27.222 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10391: Skipped 2024-09-15T12:26:27.222 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.UpdateFeatures (0 ms) 2024-09-15T12:26:27.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.FeaturesBitmaskString 2024-09-15T12:26:27.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.FeaturesBitmaskString (0 ms) 2024-09-15T12:26:27.223 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.RebuildObjectMap 2024-09-15T12:26:27.223 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:27.333 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.RebuildObjectMap (117 ms) 2024-09-15T12:26:27.333 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.RebuildNewObjectMap 2024-09-15T12:26:27.333 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10584: Skipped 2024-09-15T12:26:27.333 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.333 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.RebuildNewObjectMap (0 ms) 2024-09-15T12:26:27.333 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.CheckObjectMap 2024-09-15T12:26:27.333 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10609: Skipped 2024-09-15T12:26:27.333 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.334 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.CheckObjectMap (0 ms) 2024-09-15T12:26:27.334 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.BlockingAIO 2024-09-15T12:26:27.334 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:27.477 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.BlockingAIO (144 ms) 2024-09-15T12:26:27.477 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ExclusiveLockTransition 2024-09-15T12:26:27.477 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10737: Skipped 2024-09-15T12:26:27.478 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.478 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockTransition (0 ms) 2024-09-15T12:26:27.478 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ExclusiveLockReadTransition 2024-09-15T12:26:27.478 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10793: Skipped 2024-09-15T12:26:27.478 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.478 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition (0 ms) 2024-09-15T12:26:27.478 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.CacheMayCopyOnWrite 2024-09-15T12:26:27.478 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10846: Skipped 2024-09-15T12:26:27.478 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:27.478 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.CacheMayCopyOnWrite (0 ms) 2024-09-15T12:26:27.478 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot 2024-09-15T12:26:27.478 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:28.270 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot (793 ms) 2024-09-15T12:26:28.270 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestImageOptions 2024-09-15T12:26:32.948 INFO:tasks.workunit.client.0.smithi071.stdout:0.00% done 2024-09-15T12:26:32.948 INFO:tasks.workunit.client.0.smithi071.stdout:100.00% done 2024-09-15T12:26:32.948 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestImageOptions (4678 ms) 2024-09-15T12:26:32.948 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestImageOptionsPP 2024-09-15T12:26:35.569 INFO:tasks.workunit.client.0.smithi071.stdout:0.00% done 2024-09-15T12:26:35.570 INFO:tasks.workunit.client.0.smithi071.stdout:100.00% done 2024-09-15T12:26:35.570 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestImageOptionsPP (2621 ms) 2024-09-15T12:26:35.570 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.EventSocketPipe 2024-09-15T12:26:35.570 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.EventSocketPipe (0 ms) 2024-09-15T12:26:35.570 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.EventSocketEventfd 2024-09-15T12:26:35.570 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.EventSocketEventfd (0 ms) 2024-09-15T12:26:35.570 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ImagePollIO 2024-09-15T12:26:35.570 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:35.915 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:26:35.915 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:26:35.915 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:26:35.915 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:26:35.915 INFO:tasks.workunit.client.0.smithi071.stdout:wrote: 512 2024-09-15T12:26:35.915 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:26:35.915 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:26:35.915 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:26:35.915 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:26:35.915 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:26:35.916 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:26:35.916 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:26:35.916 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:26:35.916 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:26:35.916 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:26:35.916 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:26:35.916 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:26:35.916 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:26:35.916 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:26:35.916 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:26:35.916 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:26:35.916 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:26:35.916 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:26:35.917 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:26:35.917 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:26:35.917 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:26:35.917 INFO:tasks.workunit.client.0.smithi071.stdout:started write 2024-09-15T12:26:35.917 INFO:tasks.workunit.client.0.smithi071.stdout:write completion cb called! 2024-09-15T12:26:35.917 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 0 2024-09-15T12:26:35.917 INFO:tasks.workunit.client.0.smithi071.stdout:finished write 2024-09-15T12:26:35.917 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:26:35.917 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:26:35.917 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:26:35.917 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:26:35.917 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:26:35.917 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:26:35.917 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:26:35.918 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:26:35.918 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:26:35.918 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:26:35.918 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:26:35.918 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:26:35.918 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:26:35.918 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:26:35.918 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:26:35.918 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:26:35.918 INFO:tasks.workunit.client.0.smithi071.stdout:created completion 2024-09-15T12:26:35.918 INFO:tasks.workunit.client.0.smithi071.stdout:started read 2024-09-15T12:26:35.918 INFO:tasks.workunit.client.0.smithi071.stdout:read completion cb called! 2024-09-15T12:26:35.918 INFO:tasks.workunit.client.0.smithi071.stdout:return value is: 512 2024-09-15T12:26:35.919 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.ImagePollIO (346 ms) 2024-09-15T12:26:35.919 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.Mirror 2024-09-15T12:26:35.977 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:36.026 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:36.439 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.Mirror (525 ms) 2024-09-15T12:26:36.440 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.MirrorPeerAttributes 2024-09-15T12:26:36.581 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.MirrorPeerAttributes (141 ms) 2024-09-15T12:26:36.581 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.CreateWithMirrorEnabled 2024-09-15T12:26:36.581 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11322: Skipped 2024-09-15T12:26:36.581 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:36.582 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.CreateWithMirrorEnabled (0 ms) 2024-09-15T12:26:36.582 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-09-15T12:26:36.582 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11364: Skipped 2024-09-15T12:26:36.582 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:36.582 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot (0 ms) 2024-09-15T12:26:36.582 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ExclusiveLock 2024-09-15T12:26:36.582 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11410: Skipped 2024-09-15T12:26:36.582 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:36.582 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLock (0 ms) 2024-09-15T12:26:36.582 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.BreakLock 2024-09-15T12:26:36.582 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11553: Skipped 2024-09-15T12:26:36.582 INFO:tasks.workunit.client.0.smithi071.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:26:36.582 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.BreakLock (0 ms) 2024-09-15T12:26:36.582 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.DiscardAfterWrite 2024-09-15T12:26:36.583 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:36.686 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.DiscardAfterWrite (105 ms) 2024-09-15T12:26:36.686 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.DefaultFeatures 2024-09-15T12:26:36.686 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.DefaultFeatures (0 ms) 2024-09-15T12:26:36.686 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurge 2024-09-15T12:26:36.686 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11676: Skipped 2024-09-15T12:26:36.686 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:36.686 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurge (0 ms) 2024-09-15T12:26:36.686 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-09-15T12:26:36.686 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11722: Skipped 2024-09-15T12:26:36.686 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:36.687 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay (0 ms) 2024-09-15T12:26:36.687 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestTrashPurge 2024-09-15T12:26:36.687 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11753: Skipped 2024-09-15T12:26:36.687 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:36.687 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestTrashPurge (0 ms) 2024-09-15T12:26:36.687 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndRestore 2024-09-15T12:26:36.687 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11810: Skipped 2024-09-15T12:26:36.687 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:36.687 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndRestore (0 ms) 2024-09-15T12:26:36.687 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestListWatchers 2024-09-15T12:26:36.687 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:36.925 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestListWatchers (240 ms) 2024-09-15T12:26:36.926 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestSetSnapById 2024-09-15T12:26:36.926 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:38.247 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.TestSetSnapById (1321 ms) 2024-09-15T12:26:38.247 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.Namespaces 2024-09-15T12:26:38.615 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.Namespaces (369 ms) 2024-09-15T12:26:38.616 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.NamespacesPP 2024-09-15T12:26:39.033 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:39.048 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.NamespacesPP (432 ms) 2024-09-15T12:26:39.048 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.Migration 2024-09-15T12:26:39.048 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:39.048 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:43.376 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.Migration (4329 ms) 2024-09-15T12:26:43.377 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.MigrationPP 2024-09-15T12:26:43.377 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:43.377 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:47.921 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.MigrationPP (4543 ms) 2024-09-15T12:26:47.921 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestGetAccessTimestamp 2024-09-15T12:26:47.921 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12177: Skipped 2024-09-15T12:26:47.921 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:47.921 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestGetAccessTimestamp (0 ms) 2024-09-15T12:26:47.921 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.TestGetModifyTimestamp 2024-09-15T12:26:47.921 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12202: Skipped 2024-09-15T12:26:47.921 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:47.922 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestGetModifyTimestamp (0 ms) 2024-09-15T12:26:47.922 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ZeroOverlapFlatten 2024-09-15T12:26:47.922 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12225: Skipped 2024-09-15T12:26:47.922 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:47.922 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ZeroOverlapFlatten (0 ms) 2024-09-15T12:26:47.922 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.PoolMetadata 2024-09-15T12:26:47.922 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12258: Skipped 2024-09-15T12:26:47.922 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:47.922 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.PoolMetadata (0 ms) 2024-09-15T12:26:47.922 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.PoolMetadataPP 2024-09-15T12:26:47.922 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12370: Skipped 2024-09-15T12:26:47.922 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:47.922 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.PoolMetadataPP (0 ms) 2024-09-15T12:26:47.922 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.Config 2024-09-15T12:26:47.923 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12422: Skipped 2024-09-15T12:26:47.923 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:47.923 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.Config (0 ms) 2024-09-15T12:26:47.923 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ConfigPP 2024-09-15T12:26:47.923 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12506: Skipped 2024-09-15T12:26:47.923 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:47.923 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ConfigPP (0 ms) 2024-09-15T12:26:47.923 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.PoolStatsPP 2024-09-15T12:26:47.923 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12583: Skipped 2024-09-15T12:26:47.923 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:47.923 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.PoolStatsPP (0 ms) 2024-09-15T12:26:47.923 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ImageSpec 2024-09-15T12:26:47.923 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12658: Skipped 2024-09-15T12:26:47.923 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:47.924 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ImageSpec (0 ms) 2024-09-15T12:26:47.924 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.SnapRemoveWithChildMissing 2024-09-15T12:26:47.924 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12853: Skipped 2024-09-15T12:26:47.924 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:26:47.924 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveWithChildMissing (0 ms) 2024-09-15T12:26:47.924 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.QuiesceWatch 2024-09-15T12:26:47.924 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:26:54.477 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.QuiesceWatch (6558 ms) 2024-09-15T12:26:54.478 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.QuiesceWatchPP 2024-09-15T12:26:54.478 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:27:00.493 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.QuiesceWatchPP (6015 ms) 2024-09-15T12:27:00.494 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.QuiesceWatchError 2024-09-15T12:27:00.494 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13115: Skipped 2024-09-15T12:27:00.494 INFO:tasks.workunit.client.0.smithi071.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:00.494 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError (0 ms) 2024-09-15T12:27:00.494 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.QuiesceWatchTimeout 2024-09-15T12:27:00.494 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:27:00.588 INFO:tasks.workunit.client.0.smithi071.stderr:test quiesce is not long enough to time out 2024-09-15T12:27:09.417 INFO:tasks.workunit.client.0.smithi071.stderr:test quiesce is timed out 2024-09-15T12:27:09.445 INFO:tasks.workunit.client.0.smithi071.stderr:waiting for timed out ... 0 2024-09-15T12:27:10.445 INFO:tasks.workunit.client.0.smithi071.stderr:waiting for timed out ... 1 2024-09-15T12:27:11.445 INFO:tasks.workunit.client.0.smithi071.stderr:waiting for timed out ... 2 2024-09-15T12:27:12.446 INFO:tasks.workunit.client.0.smithi071.stderr:waiting for timed out ... 3 2024-09-15T12:27:13.446 INFO:tasks.workunit.client.0.smithi071.stderr:waiting for timed out ... 4 2024-09-15T12:27:14.446 INFO:tasks.workunit.client.0.smithi071.stderr:waiting for timed out ... 5 2024-09-15T12:27:15.446 INFO:tasks.workunit.client.0.smithi071.stderr:waiting for timed out ... 6 2024-09-15T12:27:16.446 INFO:tasks.workunit.client.0.smithi071.stderr:waiting for timed out ... 7 2024-09-15T12:27:17.446 INFO:tasks.workunit.client.0.smithi071.stderr:waiting for timed out ... 8 2024-09-15T12:27:18.446 INFO:tasks.workunit.client.0.smithi071.stderr:waiting for timed out ... 9 2024-09-15T12:27:19.446 INFO:tasks.workunit.client.0.smithi071.stderr:waiting for timed out ... 10 2024-09-15T12:27:30.447 INFO:tasks.workunit.client.0.smithi071.stderr:test retry succeeds 2024-09-15T12:27:33.626 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.QuiesceWatchTimeout (33134 ms) 2024-09-15T12:27:33.627 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.WriteZeroes 2024-09-15T12:27:33.627 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:27:33.931 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.WriteZeroes (304 ms) 2024-09-15T12:27:33.931 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.WriteZeroesThickProvision 2024-09-15T12:27:33.931 INFO:tasks.workunit.client.0.smithi071.stdout:using old format 2024-09-15T12:27:34.226 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestLibRBD.WriteZeroesThickProvision (296 ms) 2024-09-15T12:27:34.226 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.ConcurrentOperations 2024-09-15T12:27:34.227 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13474: Skipped 2024-09-15T12:27:34.227 INFO:tasks.workunit.client.0.smithi071.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:34.227 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations (0 ms) 2024-09-15T12:27:34.227 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestLibRBD.FormatAndCloneFormatOptions 2024-09-15T12:27:34.227 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13630: Skipped 2024-09-15T12:27:34.227 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:34.227 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.FormatAndCloneFormatOptions (0 ms) 2024-09-15T12:27:41.154 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 171 tests from TestLibRBD (594560 ms total) 2024-09-15T12:27:41.155 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:27:41.155 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:41.155 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 171 tests from 1 test suite ran. (601534 ms total) 2024-09-15T12:27:41.155 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 104 tests. 2024-09-15T12:27:41.155 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 67 tests, listed below: 2024-09-15T12:27:41.155 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.CreateWithSameDataPool 2024-09-15T12:27:41.155 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestGetCreateTimestamp 2024-09-15T12:27:41.155 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.GetCreateTimestampPP 2024-09-15T12:27:41.155 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopy 2024-09-15T12:27:41.155 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopyPP 2024-09-15T12:27:41.155 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestGetSnapShotTimeStamp 2024-09-15T12:27:41.155 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryDataPool 2024-09-15T12:27:41.156 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespace 2024-09-15T12:27:41.156 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespaceDataPool 2024-09-15T12:27:41.156 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestCloneEncryption 2024-09-15T12:27:41.156 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.LUKS1UnderLUKS2WithoutResize 2024-09-15T12:27:41.156 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.LUKS2UnderLUKS1WithoutResize 2024-09-15T12:27:41.156 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-15T12:27:41.156 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadFormatMismatch 2024-09-15T12:27:41.156 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.EncryptedFlattenSmallData 2024-09-15T12:27:41.156 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestDataPoolIO 2024-09-15T12:27:41.156 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestClone 2024-09-15T12:27:41.156 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestClone2 2024-09-15T12:27:41.156 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ListChildren 2024-09-15T12:27:41.156 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered 2024-09-15T12:27:41.156 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestPendingAio 2024-09-15T12:27:41.157 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyup 2024-09-15T12:27:41.157 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-09-15T12:27:41.157 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.Flatten 2024-09-15T12:27:41.157 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-09-15T12:27:41.157 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.RenameViaLockOwner 2024-09-15T12:27:41.157 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SnapCreateViaLockOwner 2024-09-15T12:27:41.157 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveViaLockOwner 2024-09-15T12:27:41.157 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-09-15T12:27:41.157 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-15T12:27:41.157 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SnapRemove2 2024-09-15T12:27:41.157 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SnapRenameViaLockOwner 2024-09-15T12:27:41.157 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SnapProtectViaLockOwner 2024-09-15T12:27:41.158 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SnapUnprotectViaLockOwner 2024-09-15T12:27:41.158 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.FlattenViaLockOwner 2024-09-15T12:27:41.158 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ResizeViaLockOwner 2024-09-15T12:27:41.158 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SparsifyViaLockOwner 2024-09-15T12:27:41.158 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ObjectMapConsistentSnap 2024-09-15T12:27:41.158 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.Metadata 2024-09-15T12:27:41.158 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.MetadataPP 2024-09-15T12:27:41.158 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.UpdateFeatures 2024-09-15T12:27:41.158 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.RebuildNewObjectMap 2024-09-15T12:27:41.158 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.CheckObjectMap 2024-09-15T12:27:41.158 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockTransition 2024-09-15T12:27:41.158 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition 2024-09-15T12:27:41.158 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.CacheMayCopyOnWrite 2024-09-15T12:27:41.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.CreateWithMirrorEnabled 2024-09-15T12:27:41.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-09-15T12:27:41.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLock 2024-09-15T12:27:41.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.BreakLock 2024-09-15T12:27:41.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurge 2024-09-15T12:27:41.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-09-15T12:27:41.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestTrashPurge 2024-09-15T12:27:41.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndRestore 2024-09-15T12:27:41.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestGetAccessTimestamp 2024-09-15T12:27:41.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.TestGetModifyTimestamp 2024-09-15T12:27:41.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ZeroOverlapFlatten 2024-09-15T12:27:41.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.PoolMetadata 2024-09-15T12:27:41.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.PoolMetadataPP 2024-09-15T12:27:41.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.Config 2024-09-15T12:27:41.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ConfigPP 2024-09-15T12:27:41.160 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.PoolStatsPP 2024-09-15T12:27:41.160 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ImageSpec 2024-09-15T12:27:41.160 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveWithChildMissing 2024-09-15T12:27:41.160 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError 2024-09-15T12:27:41.160 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations 2024-09-15T12:27:41.160 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestLibRBD.FormatAndCloneFormatOptions 2024-09-15T12:27:41.160 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:27:41.160 INFO:tasks.workunit.client.0.smithi071.stdout: YOU HAVE 1 DISABLED TEST 2024-09-15T12:27:41.160 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:27:41.223 INFO:tasks.workunit.client.0.smithi071.stdout:seed 32081 2024-09-15T12:27:41.224 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = EncryptedFlattenTest/0.* 2024-09-15T12:27:41.224 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:27:41.224 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:41.224 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/0, where TypeParam = PlaintextUnderLUKS1 2024-09-15T12:27:41.311 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/0.Simple 2024-09-15T12:27:43.166 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:27:43.166 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:43.167 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Simple (1854 ms) 2024-09-15T12:27:43.167 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/0.Grow 2024-09-15T12:27:43.167 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:27:43.167 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:43.167 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Grow (0 ms) 2024-09-15T12:27:43.167 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/0.Shrink 2024-09-15T12:27:43.167 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:27:43.167 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:43.167 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Shrink (0 ms) 2024-09-15T12:27:43.167 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOne 2024-09-15T12:27:43.167 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:27:43.167 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:43.168 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOne (0 ms) 2024-09-15T12:27:43.168 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot 2024-09-15T12:27:43.168 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:27:43.168 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:43.168 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:27:43.168 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/0.MinOverlap 2024-09-15T12:27:43.168 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:27:43.168 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:43.168 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/0.MinOverlap (0 ms) 2024-09-15T12:27:43.168 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/0.ZeroOverlap 2024-09-15T12:27:43.168 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:27:43.168 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:43.168 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ZeroOverlap (0 ms) 2024-09-15T12:27:44.165 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/0 (1854 ms total) 2024-09-15T12:27:44.165 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:27:44.165 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:44.165 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 7 tests from 1 test suite ran. (2941 ms total) 2024-09-15T12:27:44.165 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 0 tests. 2024-09-15T12:27:44.165 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:27:44.165 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Simple 2024-09-15T12:27:44.165 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Grow 2024-09-15T12:27:44.165 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Shrink 2024-09-15T12:27:44.166 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOne 2024-09-15T12:27:44.166 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot 2024-09-15T12:27:44.166 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/0.MinOverlap 2024-09-15T12:27:44.166 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ZeroOverlap 2024-09-15T12:27:44.244 INFO:tasks.workunit.client.0.smithi071.stdout:seed 32145 2024-09-15T12:27:44.244 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = EncryptedFlattenTest/1.* 2024-09-15T12:27:44.244 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:27:44.244 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:44.244 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/1, where TypeParam = PlaintextUnderLUKS2 2024-09-15T12:27:44.331 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/1.Simple 2024-09-15T12:27:46.177 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:27:46.177 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:46.177 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Simple (1846 ms) 2024-09-15T12:27:46.177 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/1.Grow 2024-09-15T12:27:46.177 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:27:46.177 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:46.177 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Grow (0 ms) 2024-09-15T12:27:46.177 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/1.Shrink 2024-09-15T12:27:46.177 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:27:46.177 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:46.178 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Shrink (0 ms) 2024-09-15T12:27:46.178 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOne 2024-09-15T12:27:46.178 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:27:46.178 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:46.178 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOne (0 ms) 2024-09-15T12:27:46.178 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot 2024-09-15T12:27:46.178 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:27:46.178 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:46.178 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:27:46.178 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/1.MinOverlap 2024-09-15T12:27:46.178 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:27:46.178 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:46.178 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/1.MinOverlap (0 ms) 2024-09-15T12:27:46.178 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/1.ZeroOverlap 2024-09-15T12:27:46.179 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:27:46.179 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:46.179 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ZeroOverlap (0 ms) 2024-09-15T12:27:47.190 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/1 (1846 ms total) 2024-09-15T12:27:47.190 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:27:47.190 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:47.190 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 7 tests from 1 test suite ran. (2946 ms total) 2024-09-15T12:27:47.190 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 0 tests. 2024-09-15T12:27:47.190 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:27:47.191 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Simple 2024-09-15T12:27:47.191 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Grow 2024-09-15T12:27:47.191 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Shrink 2024-09-15T12:27:47.191 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOne 2024-09-15T12:27:47.191 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot 2024-09-15T12:27:47.191 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/1.MinOverlap 2024-09-15T12:27:47.191 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ZeroOverlap 2024-09-15T12:27:47.255 INFO:tasks.workunit.client.0.smithi071.stdout:seed 32209 2024-09-15T12:27:47.256 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = EncryptedFlattenTest/2.* 2024-09-15T12:27:47.256 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:27:47.256 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:47.256 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/2, where TypeParam = UnformattedLUKS1 2024-09-15T12:27:47.346 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/2.Simple 2024-09-15T12:27:49.196 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:27:49.196 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:49.196 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Simple (1849 ms) 2024-09-15T12:27:49.196 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/2.Grow 2024-09-15T12:27:49.196 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:27:49.197 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:49.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Grow (0 ms) 2024-09-15T12:27:49.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/2.Shrink 2024-09-15T12:27:49.197 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:27:49.197 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:49.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Shrink (0 ms) 2024-09-15T12:27:49.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOne 2024-09-15T12:27:49.197 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:27:49.197 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:49.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOne (0 ms) 2024-09-15T12:27:49.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot 2024-09-15T12:27:49.197 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:27:49.197 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:49.198 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:27:49.198 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/2.MinOverlap 2024-09-15T12:27:49.198 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:27:49.198 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:49.198 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/2.MinOverlap (0 ms) 2024-09-15T12:27:49.198 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/2.ZeroOverlap 2024-09-15T12:27:49.198 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:27:49.198 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:49.198 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ZeroOverlap (0 ms) 2024-09-15T12:27:50.196 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/2 (1849 ms total) 2024-09-15T12:27:50.196 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:27:50.196 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:50.196 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 7 tests from 1 test suite ran. (2940 ms total) 2024-09-15T12:27:50.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 0 tests. 2024-09-15T12:27:50.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:27:50.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Simple 2024-09-15T12:27:50.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Grow 2024-09-15T12:27:50.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Shrink 2024-09-15T12:27:50.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOne 2024-09-15T12:27:50.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot 2024-09-15T12:27:50.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/2.MinOverlap 2024-09-15T12:27:50.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ZeroOverlap 2024-09-15T12:27:50.265 INFO:tasks.workunit.client.0.smithi071.stdout:seed 32273 2024-09-15T12:27:50.266 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = EncryptedFlattenTest/3.* 2024-09-15T12:27:50.266 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:27:50.266 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:50.266 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/3, where TypeParam = LUKS1UnderLUKS1 2024-09-15T12:27:50.341 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/3.Simple 2024-09-15T12:27:52.210 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:27:52.210 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:52.210 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Simple (1869 ms) 2024-09-15T12:27:52.210 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/3.Grow 2024-09-15T12:27:52.210 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:27:52.211 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:52.211 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Grow (0 ms) 2024-09-15T12:27:52.211 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/3.Shrink 2024-09-15T12:27:52.211 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:27:52.211 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:52.211 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Shrink (0 ms) 2024-09-15T12:27:52.211 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOne 2024-09-15T12:27:52.211 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:27:52.212 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:52.212 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOne (0 ms) 2024-09-15T12:27:52.212 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot 2024-09-15T12:27:52.212 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:27:52.212 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:52.212 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:27:52.213 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/3.MinOverlap 2024-09-15T12:27:52.213 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:27:52.213 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:52.213 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/3.MinOverlap (0 ms) 2024-09-15T12:27:52.213 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/3.ZeroOverlap 2024-09-15T12:27:52.213 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:27:52.213 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:52.213 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ZeroOverlap (0 ms) 2024-09-15T12:27:53.221 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/3 (1869 ms total) 2024-09-15T12:27:53.222 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:27:53.222 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:53.222 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 7 tests from 1 test suite ran. (2956 ms total) 2024-09-15T12:27:53.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 0 tests. 2024-09-15T12:27:53.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:27:53.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Simple 2024-09-15T12:27:53.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Grow 2024-09-15T12:27:53.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Shrink 2024-09-15T12:27:53.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOne 2024-09-15T12:27:53.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot 2024-09-15T12:27:53.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/3.MinOverlap 2024-09-15T12:27:53.222 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ZeroOverlap 2024-09-15T12:27:53.282 INFO:tasks.workunit.client.0.smithi071.stdout:seed 32337 2024-09-15T12:27:53.283 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = EncryptedFlattenTest/4.* 2024-09-15T12:27:53.283 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:27:53.283 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:53.283 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/4, where TypeParam = LUKS1UnderLUKS2 2024-09-15T12:27:53.375 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/4.Simple 2024-09-15T12:27:55.234 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:27:55.234 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:55.235 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Simple (1859 ms) 2024-09-15T12:27:55.235 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/4.Grow 2024-09-15T12:27:55.235 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:27:55.235 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:55.235 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Grow (0 ms) 2024-09-15T12:27:55.235 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/4.Shrink 2024-09-15T12:27:55.235 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:27:55.235 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:55.235 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Shrink (0 ms) 2024-09-15T12:27:55.235 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOne 2024-09-15T12:27:55.235 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:27:55.235 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:55.235 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOne (0 ms) 2024-09-15T12:27:55.236 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot 2024-09-15T12:27:55.236 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:27:55.236 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:55.236 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:27:55.236 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/4.MinOverlap 2024-09-15T12:27:55.236 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:27:55.236 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:55.236 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/4.MinOverlap (0 ms) 2024-09-15T12:27:55.236 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/4.ZeroOverlap 2024-09-15T12:27:55.236 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:27:55.236 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:55.236 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ZeroOverlap (0 ms) 2024-09-15T12:27:56.236 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/4 (1859 ms total) 2024-09-15T12:27:56.236 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:27:56.236 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:56.236 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 7 tests from 1 test suite ran. (2953 ms total) 2024-09-15T12:27:56.236 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 0 tests. 2024-09-15T12:27:56.237 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:27:56.237 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Simple 2024-09-15T12:27:56.237 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Grow 2024-09-15T12:27:56.237 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Shrink 2024-09-15T12:27:56.237 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOne 2024-09-15T12:27:56.237 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot 2024-09-15T12:27:56.237 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/4.MinOverlap 2024-09-15T12:27:56.237 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ZeroOverlap 2024-09-15T12:27:56.301 INFO:tasks.workunit.client.0.smithi071.stdout:seed 32401 2024-09-15T12:27:56.301 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = EncryptedFlattenTest/5.* 2024-09-15T12:27:56.301 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:27:56.301 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:56.301 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/5, where TypeParam = UnformattedLUKS2 2024-09-15T12:27:56.391 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/5.Simple 2024-09-15T12:27:58.001 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:27:58.001 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:58.001 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Simple (1610 ms) 2024-09-15T12:27:58.002 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/5.Grow 2024-09-15T12:27:58.002 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:27:58.002 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:58.002 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Grow (0 ms) 2024-09-15T12:27:58.002 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/5.Shrink 2024-09-15T12:27:58.002 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:27:58.002 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:58.002 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Shrink (0 ms) 2024-09-15T12:27:58.002 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOne 2024-09-15T12:27:58.002 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:27:58.002 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:58.002 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOne (0 ms) 2024-09-15T12:27:58.003 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot 2024-09-15T12:27:58.003 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:27:58.003 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:58.003 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:27:58.003 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/5.MinOverlap 2024-09-15T12:27:58.003 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:27:58.003 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:58.003 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/5.MinOverlap (0 ms) 2024-09-15T12:27:58.003 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/5.ZeroOverlap 2024-09-15T12:27:58.003 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:27:58.003 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:27:58.003 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ZeroOverlap (0 ms) 2024-09-15T12:27:59.001 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/5 (1610 ms total) 2024-09-15T12:27:59.002 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:27:59.002 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:59.002 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 7 tests from 1 test suite ran. (2700 ms total) 2024-09-15T12:27:59.002 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 0 tests. 2024-09-15T12:27:59.002 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:27:59.002 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Simple 2024-09-15T12:27:59.002 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Grow 2024-09-15T12:27:59.002 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Shrink 2024-09-15T12:27:59.002 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOne 2024-09-15T12:27:59.002 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot 2024-09-15T12:27:59.002 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/5.MinOverlap 2024-09-15T12:27:59.002 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ZeroOverlap 2024-09-15T12:27:59.069 INFO:tasks.workunit.client.0.smithi071.stdout:seed 32465 2024-09-15T12:27:59.070 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = EncryptedFlattenTest/6.* 2024-09-15T12:27:59.070 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:27:59.070 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:59.070 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/6, where TypeParam = LUKS2UnderLUKS2 2024-09-15T12:27:59.154 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/6.Simple 2024-09-15T12:28:01.015 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:28:01.015 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:01.015 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Simple (1861 ms) 2024-09-15T12:28:01.015 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/6.Grow 2024-09-15T12:28:01.015 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:28:01.015 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:01.016 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Grow (0 ms) 2024-09-15T12:28:01.016 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/6.Shrink 2024-09-15T12:28:01.016 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:28:01.016 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:01.016 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Shrink (0 ms) 2024-09-15T12:28:01.016 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOne 2024-09-15T12:28:01.016 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:28:01.016 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:01.016 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOne (0 ms) 2024-09-15T12:28:01.016 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot 2024-09-15T12:28:01.016 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:28:01.016 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:01.016 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:28:01.016 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/6.MinOverlap 2024-09-15T12:28:01.017 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:28:01.017 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:01.017 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/6.MinOverlap (0 ms) 2024-09-15T12:28:01.017 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/6.ZeroOverlap 2024-09-15T12:28:01.017 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:28:01.017 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:01.017 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ZeroOverlap (0 ms) 2024-09-15T12:28:02.000 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/6 (1861 ms total) 2024-09-15T12:28:02.000 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:28:02.000 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:28:02.000 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 7 tests from 1 test suite ran. (2930 ms total) 2024-09-15T12:28:02.000 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 0 tests. 2024-09-15T12:28:02.000 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:28:02.000 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Simple 2024-09-15T12:28:02.000 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Grow 2024-09-15T12:28:02.000 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Shrink 2024-09-15T12:28:02.001 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOne 2024-09-15T12:28:02.001 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot 2024-09-15T12:28:02.001 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/6.MinOverlap 2024-09-15T12:28:02.001 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ZeroOverlap 2024-09-15T12:28:02.074 INFO:tasks.workunit.client.0.smithi071.stdout:seed 32530 2024-09-15T12:28:02.075 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = EncryptedFlattenTest/7.* 2024-09-15T12:28:02.075 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:28:02.075 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:28:02.075 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/7, where TypeParam = LUKS2UnderLUKS1 2024-09-15T12:28:02.168 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/7.Simple 2024-09-15T12:28:04.022 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-15T12:28:04.022 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:04.022 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Simple (1853 ms) 2024-09-15T12:28:04.022 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/7.Grow 2024-09-15T12:28:04.022 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-15T12:28:04.022 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:04.022 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Grow (0 ms) 2024-09-15T12:28:04.022 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/7.Shrink 2024-09-15T12:28:04.022 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-15T12:28:04.022 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:04.023 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Shrink (0 ms) 2024-09-15T12:28:04.023 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOne 2024-09-15T12:28:04.023 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-15T12:28:04.023 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:04.023 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOne (0 ms) 2024-09-15T12:28:04.023 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot 2024-09-15T12:28:04.023 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-15T12:28:04.023 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:04.023 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot (0 ms) 2024-09-15T12:28:04.023 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/7.MinOverlap 2024-09-15T12:28:04.023 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-15T12:28:04.023 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:04.024 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/7.MinOverlap (0 ms) 2024-09-15T12:28:04.024 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] EncryptedFlattenTest/7.ZeroOverlap 2024-09-15T12:28:04.024 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-15T12:28:04.024 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:04.024 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ZeroOverlap (0 ms) 2024-09-15T12:28:05.025 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 7 tests from EncryptedFlattenTest/7 (1853 ms total) 2024-09-15T12:28:05.025 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:28:05.025 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:28:05.025 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 7 tests from 1 test suite ran. (2949 ms total) 2024-09-15T12:28:05.025 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 0 tests. 2024-09-15T12:28:05.025 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-15T12:28:05.025 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Simple 2024-09-15T12:28:05.026 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Grow 2024-09-15T12:28:05.026 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Shrink 2024-09-15T12:28:05.026 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOne 2024-09-15T12:28:05.026 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot 2024-09-15T12:28:05.026 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/7.MinOverlap 2024-09-15T12:28:05.026 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ZeroOverlap 2024-09-15T12:28:05.091 INFO:tasks.workunit.client.0.smithi071.stdout:seed 32594 2024-09-15T12:28:05.091 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = TestImageWatcher.* 2024-09-15T12:28:05.091 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-15T12:28:05.092 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:28:05.092 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 17 tests from TestImageWatcher 2024-09-15T12:28:07.074 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifyHeaderUpdate 2024-09-15T12:28:09.187 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:460: Skipped 2024-09-15T12:28:09.187 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.187 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyHeaderUpdate (2113 ms) 2024-09-15T12:28:09.187 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifyFlatten 2024-09-15T12:28:09.233 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:478: Skipped 2024-09-15T12:28:09.233 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.233 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyFlatten (47 ms) 2024-09-15T12:28:09.233 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifyResize 2024-09-15T12:28:09.279 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:512: Skipped 2024-09-15T12:28:09.279 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.279 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyResize (46 ms) 2024-09-15T12:28:09.279 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifyRebuildObjectMap 2024-09-15T12:28:09.327 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:546: Skipped 2024-09-15T12:28:09.327 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.327 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyRebuildObjectMap (47 ms) 2024-09-15T12:28:09.327 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifyUpdateFeatures 2024-09-15T12:28:09.387 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:581: Skipped 2024-09-15T12:28:09.388 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.388 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyUpdateFeatures (61 ms) 2024-09-15T12:28:09.388 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifySnapCreate 2024-09-15T12:28:09.437 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:611: Skipped 2024-09-15T12:28:09.438 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.438 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreate (50 ms) 2024-09-15T12:28:09.438 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifySnapCreateError 2024-09-15T12:28:09.488 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:646: Skipped 2024-09-15T12:28:09.488 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.488 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreateError (50 ms) 2024-09-15T12:28:09.488 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifySnapRename 2024-09-15T12:28:09.537 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:670: Skipped 2024-09-15T12:28:09.537 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.537 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRename (49 ms) 2024-09-15T12:28:09.537 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifySnapRenameError 2024-09-15T12:28:09.585 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:701: Skipped 2024-09-15T12:28:09.585 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.586 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRenameError (49 ms) 2024-09-15T12:28:09.586 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifySnapRemove 2024-09-15T12:28:09.636 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:723: Skipped 2024-09-15T12:28:09.636 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.636 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRemove (50 ms) 2024-09-15T12:28:09.636 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifySnapProtect 2024-09-15T12:28:09.687 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:754: Skipped 2024-09-15T12:28:09.688 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.688 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapProtect (52 ms) 2024-09-15T12:28:09.688 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifySnapUnprotect 2024-09-15T12:28:09.737 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:785: Skipped 2024-09-15T12:28:09.737 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.737 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapUnprotect (50 ms) 2024-09-15T12:28:09.738 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifyRename 2024-09-15T12:28:09.784 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:816: Skipped 2024-09-15T12:28:09.784 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.784 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyRename (46 ms) 2024-09-15T12:28:09.784 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifyAsyncTimedOut 2024-09-15T12:28:09.833 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:847: Skipped 2024-09-15T12:28:09.834 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.834 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncTimedOut (50 ms) 2024-09-15T12:28:09.834 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifyAsyncError 2024-09-15T12:28:09.883 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:867: Skipped 2024-09-15T12:28:09.883 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.883 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncError (49 ms) 2024-09-15T12:28:09.883 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifyAsyncCompleteError 2024-09-15T12:28:09.933 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:887: Skipped 2024-09-15T12:28:09.933 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.933 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncCompleteError (50 ms) 2024-09-15T12:28:09.933 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-09-15T12:28:09.982 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:918: Skipped 2024-09-15T12:28:09.983 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:09.983 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncRequestTimedOut (50 ms) 2024-09-15T12:28:10.083 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 17 tests from TestImageWatcher (2909 ms total) 2024-09-15T12:28:10.083 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:28:10.083 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:28:10.083 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 17 tests from 1 test suite ran. (4991 ms total) 2024-09-15T12:28:10.083 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 0 tests. 2024-09-15T12:28:10.083 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 17 tests, listed below: 2024-09-15T12:28:10.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyHeaderUpdate 2024-09-15T12:28:10.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyFlatten 2024-09-15T12:28:10.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyResize 2024-09-15T12:28:10.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyRebuildObjectMap 2024-09-15T12:28:10.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyUpdateFeatures 2024-09-15T12:28:10.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreate 2024-09-15T12:28:10.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreateError 2024-09-15T12:28:10.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRename 2024-09-15T12:28:10.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRenameError 2024-09-15T12:28:10.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRemove 2024-09-15T12:28:10.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapProtect 2024-09-15T12:28:10.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapUnprotect 2024-09-15T12:28:10.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyRename 2024-09-15T12:28:10.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncTimedOut 2024-09-15T12:28:10.085 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncError 2024-09-15T12:28:10.085 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncCompleteError 2024-09-15T12:28:10.085 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-09-15T12:28:10.144 INFO:tasks.workunit.client.0.smithi071.stdout:seed 32643 2024-09-15T12:28:10.144 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = TestInternal.* 2024-09-15T12:28:10.145 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 34 tests from 1 test suite. 2024-09-15T12:28:10.145 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:28:10.145 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 34 tests from TestInternal 2024-09-15T12:28:12.001 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.OpenByID 2024-09-15T12:28:14.213 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:176: Skipped 2024-09-15T12:28:14.213 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:14.214 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.OpenByID (2211 ms) 2024-09-15T12:28:14.214 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.OpenSnapDNE 2024-09-15T12:28:14.348 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestInternal.OpenSnapDNE (136 ms) 2024-09-15T12:28:14.349 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.IsExclusiveLockOwner 2024-09-15T12:28:14.403 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:198: Skipped 2024-09-15T12:28:14.404 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:14.404 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.IsExclusiveLockOwner (55 ms) 2024-09-15T12:28:14.404 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.ResizeLocksImage 2024-09-15T12:28:14.460 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:218: Skipped 2024-09-15T12:28:14.460 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:14.460 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.ResizeLocksImage (56 ms) 2024-09-15T12:28:14.460 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.ResizeFailsToLockImage 2024-09-15T12:28:14.511 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:232: Skipped 2024-09-15T12:28:14.512 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:14.512 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.ResizeFailsToLockImage (52 ms) 2024-09-15T12:28:14.512 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.SnapCreateLocksImage 2024-09-15T12:28:14.559 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:243: Skipped 2024-09-15T12:28:14.559 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:14.559 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapCreateLocksImage (47 ms) 2024-09-15T12:28:14.560 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.SnapCreateFailsToLockImage 2024-09-15T12:28:14.606 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:261: Skipped 2024-09-15T12:28:14.606 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:14.606 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapCreateFailsToLockImage (47 ms) 2024-09-15T12:28:14.606 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.SnapRollbackLocksImage 2024-09-15T12:28:14.658 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:271: Skipped 2024-09-15T12:28:14.658 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:14.659 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapRollbackLocksImage (52 ms) 2024-09-15T12:28:14.659 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.SnapRollbackFailsToLockImage 2024-09-15T12:28:14.706 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:289: Skipped 2024-09-15T12:28:14.707 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:14.707 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapRollbackFailsToLockImage (49 ms) 2024-09-15T12:28:14.707 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.SnapSetReleasesLock 2024-09-15T12:28:14.760 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:306: Skipped 2024-09-15T12:28:14.760 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:14.760 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapSetReleasesLock (53 ms) 2024-09-15T12:28:14.760 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.FlattenLocksImage 2024-09-15T12:28:14.807 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:321: Skipped 2024-09-15T12:28:14.807 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:14.807 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.FlattenLocksImage (47 ms) 2024-09-15T12:28:14.807 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.FlattenFailsToLockImage 2024-09-15T12:28:14.855 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:348: Skipped 2024-09-15T12:28:14.855 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:14.855 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.FlattenFailsToLockImage (48 ms) 2024-09-15T12:28:14.855 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-15T12:28:14.913 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:382: Skipped 2024-09-15T12:28:14.913 INFO:tasks.workunit.client.0.smithi071.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:28:14.913 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted (58 ms) 2024-09-15T12:28:14.913 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-15T12:28:14.958 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:416: Skipped 2024-09-15T12:28:14.959 INFO:tasks.workunit.client.0.smithi071.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:28:14.959 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch (46 ms) 2024-09-15T12:28:14.959 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.AioWriteRequestsLock 2024-09-15T12:28:15.007 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:455: Skipped 2024-09-15T12:28:15.007 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:15.008 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.AioWriteRequestsLock (49 ms) 2024-09-15T12:28:15.008 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.AioDiscardRequestsLock 2024-09-15T12:28:15.056 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:481: Skipped 2024-09-15T12:28:15.056 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:15.056 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.AioDiscardRequestsLock (48 ms) 2024-09-15T12:28:15.056 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.CancelAsyncResize 2024-09-15T12:28:15.108 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:503: Skipped 2024-09-15T12:28:15.108 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:15.108 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.CancelAsyncResize (52 ms) 2024-09-15T12:28:15.108 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.MultipleResize 2024-09-15T12:28:15.613 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestInternal.MultipleResize (505 ms) 2024-09-15T12:28:15.613 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.Metadata 2024-09-15T12:28:15.661 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:592: Skipped 2024-09-15T12:28:15.661 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:15.661 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.Metadata (48 ms) 2024-09-15T12:28:15.661 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.MetadataConfApply 2024-09-15T12:28:15.709 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:639: Skipped 2024-09-15T12:28:15.709 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:15.709 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.MetadataConfApply (49 ms) 2024-09-15T12:28:15.709 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.SnapshotCopyup 2024-09-15T12:28:15.761 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:662: Skipped 2024-09-15T12:28:15.761 INFO:tasks.workunit.client.0.smithi071.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:28:15.761 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup (51 ms) 2024-09-15T12:28:15.761 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.SnapshotCopyupZeros 2024-09-15T12:28:15.810 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:814: Skipped 2024-09-15T12:28:15.810 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:15.810 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZeros (49 ms) 2024-09-15T12:28:15.810 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.SnapshotCopyupZerosMigration 2024-09-15T12:28:15.858 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:902: Skipped 2024-09-15T12:28:15.859 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:15.859 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZerosMigration (49 ms) 2024-09-15T12:28:15.859 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.ResizeCopyup 2024-09-15T12:28:15.906 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:987: Skipped 2024-09-15T12:28:15.907 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:15.907 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.ResizeCopyup (48 ms) 2024-09-15T12:28:15.907 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.DiscardCopyup 2024-09-15T12:28:15.954 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1052: Skipped 2024-09-15T12:28:15.955 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:15.955 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.DiscardCopyup (48 ms) 2024-09-15T12:28:15.955 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.ImageOptions 2024-09-15T12:28:16.007 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestInternal.ImageOptions (53 ms) 2024-09-15T12:28:16.007 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.WriteFullCopyup 2024-09-15T12:28:16.056 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1183: Skipped 2024-09-15T12:28:16.056 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:16.057 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.WriteFullCopyup (49 ms) 2024-09-15T12:28:16.057 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.DiffIterateCloneOverwrite 2024-09-15T12:28:16.104 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1257: Skipped 2024-09-15T12:28:16.104 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:16.104 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.DiffIterateCloneOverwrite (47 ms) 2024-09-15T12:28:16.104 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.TestCoR 2024-09-15T12:28:16.153 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1307: Skipped 2024-09-15T12:28:16.153 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:16.153 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.TestCoR (49 ms) 2024-09-15T12:28:16.153 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.FlattenNoEmptyObjects 2024-09-15T12:28:16.202 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1455: Skipped 2024-09-15T12:28:16.203 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:16.203 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.FlattenNoEmptyObjects (50 ms) 2024-09-15T12:28:16.203 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.PoolMetadataConfApply 2024-09-15T12:28:16.252 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1574: Skipped 2024-09-15T12:28:16.252 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:16.252 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.PoolMetadataConfApply (50 ms) 2024-09-15T12:28:16.253 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.Sparsify 2024-09-15T12:28:16.457 INFO:tasks.workunit.client.0.smithi071.stdout:sparsify_supported=1 2024-09-15T12:28:16.457 INFO:tasks.workunit.client.0.smithi071.stdout:sparse_read_supported=1 2024-09-15T12:28:16.758 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestInternal.Sparsify (505 ms) 2024-09-15T12:28:16.758 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.SparsifyClone 2024-09-15T12:28:16.807 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1737: Skipped 2024-09-15T12:28:16.807 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:16.807 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SparsifyClone (49 ms) 2024-09-15T12:28:16.807 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestInternal.MissingDataPool 2024-09-15T12:28:16.853 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1800: Skipped 2024-09-15T12:28:16.853 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:16.854 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.MissingDataPool (46 ms) 2024-09-15T12:28:17.121 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 34 tests from TestInternal (4851 ms total) 2024-09-15T12:28:17.121 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:28:17.121 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:28:17.121 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 34 tests from 1 test suite ran. (6973 ms total) 2024-09-15T12:28:17.121 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 4 tests. 2024-09-15T12:28:17.121 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 30 tests, listed below: 2024-09-15T12:28:17.121 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.OpenByID 2024-09-15T12:28:17.121 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.IsExclusiveLockOwner 2024-09-15T12:28:17.122 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.ResizeLocksImage 2024-09-15T12:28:17.122 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.ResizeFailsToLockImage 2024-09-15T12:28:17.122 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapCreateLocksImage 2024-09-15T12:28:17.122 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapCreateFailsToLockImage 2024-09-15T12:28:17.122 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapRollbackLocksImage 2024-09-15T12:28:17.122 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapRollbackFailsToLockImage 2024-09-15T12:28:17.122 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapSetReleasesLock 2024-09-15T12:28:17.122 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.FlattenLocksImage 2024-09-15T12:28:17.122 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.FlattenFailsToLockImage 2024-09-15T12:28:17.122 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-15T12:28:17.122 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-15T12:28:17.122 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.AioWriteRequestsLock 2024-09-15T12:28:17.122 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.AioDiscardRequestsLock 2024-09-15T12:28:17.122 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.CancelAsyncResize 2024-09-15T12:28:17.123 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.Metadata 2024-09-15T12:28:17.123 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.MetadataConfApply 2024-09-15T12:28:17.123 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup 2024-09-15T12:28:17.123 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZeros 2024-09-15T12:28:17.123 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZerosMigration 2024-09-15T12:28:17.123 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.ResizeCopyup 2024-09-15T12:28:17.123 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.DiscardCopyup 2024-09-15T12:28:17.123 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.WriteFullCopyup 2024-09-15T12:28:17.123 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.DiffIterateCloneOverwrite 2024-09-15T12:28:17.123 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.TestCoR 2024-09-15T12:28:17.123 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.FlattenNoEmptyObjects 2024-09-15T12:28:17.123 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.PoolMetadataConfApply 2024-09-15T12:28:17.123 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.SparsifyClone 2024-09-15T12:28:17.123 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestInternal.MissingDataPool 2024-09-15T12:28:17.193 INFO:tasks.workunit.client.0.smithi071.stdout:seed 32695 2024-09-15T12:28:17.194 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = TestMirroring.* 2024-09-15T12:28:17.194 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 51 tests from 1 test suite. 2024-09-15T12:28:17.194 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:28:17.194 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 51 tests from TestMirroring 2024-09-15T12:28:19.126 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage 2024-09-15T12:28:22.715 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage (3590 ms) 2024-09-15T12:28:22.716 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool 2024-09-15T12:28:24.472 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool (1756 ms) 2024-09-15T12:28:24.472 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled 2024-09-15T12:28:25.738 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled (1266 ms) 2024-09-15T12:28:25.738 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage 2024-09-15T12:28:27.461 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage (1723 ms) 2024-09-15T12:28:27.461 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap 2024-09-15T12:28:28.963 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap (1502 ms) 2024-09-15T12:28:28.963 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModePool 2024-09-15T12:28:30.536 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModePool (1573 ms) 2024-09-15T12:28:30.536 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled 2024-09-15T12:28:32.346 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled (1810 ms) 2024-09-15T12:28:32.346 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.DisableImageMirrorWithPeer 2024-09-15T12:28:32.347 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:482: Skipped 2024-09-15T12:28:32.347 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:32.347 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer (0 ms) 2024-09-15T12:28:32.347 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.DisableJournalingWithPeer 2024-09-15T12:28:32.347 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:520: Skipped 2024-09-15T12:28:32.347 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:28:32.347 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer (0 ms) 2024-09-15T12:28:32.347 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling 2024-09-15T12:28:33.421 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling (1075 ms) 2024-09-15T12:28:33.421 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling 2024-09-15T12:28:34.621 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling (1201 ms) 2024-09-15T12:28:34.622 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling 2024-09-15T12:28:36.774 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling (2152 ms) 2024-09-15T12:28:36.774 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock 2024-09-15T12:28:38.649 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock (1876 ms) 2024-09-15T12:28:38.649 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeDisabled 2024-09-15T12:28:39.998 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeDisabled (1348 ms) 2024-09-15T12:28:39.998 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage 2024-09-15T12:28:41.403 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage (1406 ms) 2024-09-15T12:28:41.403 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool 2024-09-15T12:28:43.020 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool (1616 ms) 2024-09-15T12:28:43.020 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling 2024-09-15T12:28:44.320 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling (1300 ms) 2024-09-15T12:28:44.320 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling 2024-09-15T12:28:45.537 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling (1218 ms) 2024-09-15T12:28:45.538 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeDisabled 2024-09-15T12:28:47.028 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeDisabled (1490 ms) 2024-09-15T12:28:47.028 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage 2024-09-15T12:28:48.582 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage (1554 ms) 2024-09-15T12:28:48.582 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled 2024-09-15T12:28:52.018 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled (3436 ms) 2024-09-15T12:28:52.018 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModePool 2024-09-15T12:28:53.778 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModePool (1761 ms) 2024-09-15T12:28:53.778 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModePool 2024-09-15T12:28:55.456 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModePool (1677 ms) 2024-09-15T12:28:55.456 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModeImage 2024-09-15T12:28:57.045 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModeImage (1590 ms) 2024-09-15T12:28:57.046 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode 2024-09-15T12:28:59.539 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode (2493 ms) 2024-09-15T12:28:59.539 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode 2024-09-15T12:29:02.106 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode (2568 ms) 2024-09-15T12:29:02.107 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode 2024-09-15T12:29:04.231 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode (2124 ms) 2024-09-15T12:29:04.231 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode 2024-09-15T12:29:06.485 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode (2254 ms) 2024-09-15T12:29:06.485 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode 2024-09-15T12:29:08.917 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode (2432 ms) 2024-09-15T12:29:08.917 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode 2024-09-15T12:29:11.604 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode (2687 ms) 2024-09-15T12:29:11.604 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageEnabled 2024-09-15T12:29:12.918 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageEnabled (1314 ms) 2024-09-15T12:29:12.918 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDisabled 2024-09-15T12:29:14.105 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDisabled (1186 ms) 2024-09-15T12:29:14.105 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.RemoveImage_With_ImageWithoutJournal 2024-09-15T12:29:15.116 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.RemoveImage_With_ImageWithoutJournal (1012 ms) 2024-09-15T12:29:15.117 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDemoted 2024-09-15T12:29:17.304 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDemoted (2187 ms) 2024-09-15T12:29:17.304 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.TrashMoveRestore_PoolMode 2024-09-15T12:29:19.277 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.TrashMoveRestore_PoolMode (1972 ms) 2024-09-15T12:29:19.277 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled 2024-09-15T12:29:20.941 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled (1664 ms) 2024-09-15T12:29:20.941 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled 2024-09-15T12:29:22.716 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled (1775 ms) 2024-09-15T12:29:22.716 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.MirrorStatusList 2024-09-15T12:29:23.967 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.MirrorStatusList (1252 ms) 2024-09-15T12:29:23.967 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.RemoveBootstrapped 2024-09-15T12:29:25.444 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.RemoveBootstrapped (1477 ms) 2024-09-15T12:29:25.445 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.AioPromoteDemote 2024-09-15T12:29:33.270 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.AioPromoteDemote (7825 ms) 2024-09-15T12:29:33.270 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.AioGetInfo 2024-09-15T12:29:38.855 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.AioGetInfo (5585 ms) 2024-09-15T12:29:38.855 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.AioGetStatus 2024-09-15T12:29:42.525 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.AioGetStatus (3670 ms) 2024-09-15T12:29:42.525 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.SiteName 2024-09-15T12:29:42.531 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.SiteName (7 ms) 2024-09-15T12:29:42.531 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.Bootstrap 2024-09-15T12:29:57.502 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.Bootstrap (14970 ms) 2024-09-15T12:29:57.502 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.PeerDirection 2024-09-15T12:29:57.600 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroring.PeerDirection (97 ms) 2024-09-15T12:29:57.600 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.Snapshot 2024-09-15T12:29:57.600 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1109: Skipped 2024-09-15T12:29:57.600 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:57.600 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.Snapshot (0 ms) 2024-09-15T12:29:57.600 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.SnapshotRemoveOnDisable 2024-09-15T12:29:57.600 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1188: Skipped 2024-09-15T12:29:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.SnapshotRemoveOnDisable (0 ms) 2024-09-15T12:29:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.SnapshotUnlinkPeer 2024-09-15T12:29:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1226: Skipped 2024-09-15T12:29:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.SnapshotUnlinkPeer (0 ms) 2024-09-15T12:29:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.SnapshotImageState 2024-09-15T12:29:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1339: Skipped 2024-09-15T12:29:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.SnapshotImageState (1 ms) 2024-09-15T12:29:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.SnapshotPromoteDemote 2024-09-15T12:29:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1449: Skipped 2024-09-15T12:29:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.SnapshotPromoteDemote (0 ms) 2024-09-15T12:29:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroring.AioSnapshotCreate 2024-09-15T12:29:57.602 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1484: Skipped 2024-09-15T12:29:57.602 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:29:57.602 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.AioSnapshotCreate (0 ms) 2024-09-15T12:29:58.575 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 51 tests from TestMirroring (98474 ms total) 2024-09-15T12:29:58.575 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:29:58.576 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:29:58.576 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 51 tests from 1 test suite ran. (101381 ms total) 2024-09-15T12:29:58.576 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 43 tests. 2024-09-15T12:29:58.576 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-15T12:29:58.576 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer 2024-09-15T12:29:58.576 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer 2024-09-15T12:29:58.576 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.Snapshot 2024-09-15T12:29:58.576 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.SnapshotRemoveOnDisable 2024-09-15T12:29:58.576 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.SnapshotUnlinkPeer 2024-09-15T12:29:58.576 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.SnapshotImageState 2024-09-15T12:29:58.576 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.SnapshotPromoteDemote 2024-09-15T12:29:58.576 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestMirroring.AioSnapshotCreate 2024-09-15T12:29:58.701 INFO:tasks.workunit.client.0.smithi071.stdout:seed 33200 2024-09-15T12:29:58.701 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = TestGroup.* 2024-09-15T12:29:58.701 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-15T12:29:58.702 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:29:58.702 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 13 tests from TestGroup 2024-09-15T12:30:00.575 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestGroup.group_create 2024-09-15T12:30:02.801 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestGroup.group_create (2226 ms) 2024-09-15T12:30:02.801 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestGroup.group_createPP 2024-09-15T12:30:03.003 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestGroup.group_createPP (202 ms) 2024-09-15T12:30:03.003 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestGroup.group_get_id 2024-09-15T12:30:03.153 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestGroup.group_get_id (151 ms) 2024-09-15T12:30:03.153 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestGroup.group_get_idPP 2024-09-15T12:30:03.294 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestGroup.group_get_idPP (140 ms) 2024-09-15T12:30:03.294 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestGroup.add_image 2024-09-15T12:30:03.341 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:113: Skipped 2024-09-15T12:30:03.341 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:03.341 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.add_image (47 ms) 2024-09-15T12:30:03.341 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestGroup.add_imagePP 2024-09-15T12:30:03.389 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:195: Skipped 2024-09-15T12:30:03.389 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:03.389 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.add_imagePP (48 ms) 2024-09-15T12:30:03.389 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestGroup.add_snapshot 2024-09-15T12:30:03.435 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:260: Skipped 2024-09-15T12:30:03.435 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:03.435 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.add_snapshot (47 ms) 2024-09-15T12:30:03.436 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestGroup.add_snapshotPP 2024-09-15T12:30:03.482 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:413: Skipped 2024-09-15T12:30:03.482 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:03.482 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.add_snapshotPP (46 ms) 2024-09-15T12:30:03.482 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestGroup.snap_get_info 2024-09-15T12:30:03.527 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:498: Skipped 2024-09-15T12:30:03.527 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:03.527 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.snap_get_info (46 ms) 2024-09-15T12:30:03.527 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestGroup.snap_get_infoPP 2024-09-15T12:30:03.573 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:553: Skipped 2024-09-15T12:30:03.573 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:03.573 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.snap_get_infoPP (45 ms) 2024-09-15T12:30:03.573 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestGroup.snap_list2 2024-09-15T12:30:03.622 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:601: Skipped 2024-09-15T12:30:03.622 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:03.622 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.snap_list2 (50 ms) 2024-09-15T12:30:03.622 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestGroup.snap_list2PP 2024-09-15T12:30:03.669 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:700: Skipped 2024-09-15T12:30:03.669 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:03.669 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.snap_list2PP (46 ms) 2024-09-15T12:30:03.669 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestGroup.snap_list_internal 2024-09-15T12:30:03.715 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:781: Skipped 2024-09-15T12:30:03.715 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:03.715 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.snap_list_internal (46 ms) 2024-09-15T12:30:04.603 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 13 tests from TestGroup (3140 ms total) 2024-09-15T12:30:04.603 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:30:04.603 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:30:04.603 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 13 tests from 1 test suite ran. (5901 ms total) 2024-09-15T12:30:04.603 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 4 tests. 2024-09-15T12:30:04.603 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 9 tests, listed below: 2024-09-15T12:30:04.603 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.add_image 2024-09-15T12:30:04.603 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.add_imagePP 2024-09-15T12:30:04.604 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.add_snapshot 2024-09-15T12:30:04.604 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.add_snapshotPP 2024-09-15T12:30:04.604 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.snap_get_info 2024-09-15T12:30:04.604 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.snap_get_infoPP 2024-09-15T12:30:04.604 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.snap_list2 2024-09-15T12:30:04.604 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.snap_list2PP 2024-09-15T12:30:04.604 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestGroup.snap_list_internal 2024-09-15T12:30:04.672 INFO:tasks.workunit.client.0.smithi071.stdout:seed 33249 2024-09-15T12:30:04.673 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = TestMirroringWatcher.* 2024-09-15T12:30:04.673 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-15T12:30:04.673 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:30:04.673 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 2 tests from TestMirroringWatcher 2024-09-15T12:30:06.612 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroringWatcher.ModeUpdated 2024-09-15T12:30:08.849 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroringWatcher.ModeUpdated (2236 ms) 2024-09-15T12:30:08.849 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestMirroringWatcher.ImageStatusUpdated 2024-09-15T12:30:08.993 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestMirroringWatcher.ImageStatusUpdated (144 ms) 2024-09-15T12:30:09.626 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 2 tests from TestMirroringWatcher (2380 ms total) 2024-09-15T12:30:09.626 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:30:09.626 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:30:09.627 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 2 tests from 1 test suite ran. (4953 ms total) 2024-09-15T12:30:09.627 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 2 tests. 2024-09-15T12:30:09.693 INFO:tasks.workunit.client.0.smithi071.stdout:seed 33301 2024-09-15T12:30:09.693 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = TestObjectMap.* 2024-09-15T12:30:09.693 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-15T12:30:09.694 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:30:09.694 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 4 tests from TestObjectMap 2024-09-15T12:30:11.633 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-09-15T12:30:14.134 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:38: Skipped 2024-09-15T12:30:14.135 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:14.135 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenCorrupt (2502 ms) 2024-09-15T12:30:14.135 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-09-15T12:30:14.178 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:66: Skipped 2024-09-15T12:30:14.178 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:14.178 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenTooSmall (43 ms) 2024-09-15T12:30:14.178 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestObjectMap.InvalidateFlagOnDisk 2024-09-15T12:30:14.223 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:95: Skipped 2024-09-15T12:30:14.223 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:14.223 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestObjectMap.InvalidateFlagOnDisk (45 ms) 2024-09-15T12:30:14.223 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-09-15T12:30:14.268 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:128: Skipped 2024-09-15T12:30:14.268 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:14.268 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall (46 ms) 2024-09-15T12:30:15.029 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 4 tests from TestObjectMap (2636 ms total) 2024-09-15T12:30:15.030 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:30:15.030 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:30:15.030 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 4 tests from 1 test suite ran. (5336 ms total) 2024-09-15T12:30:15.030 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 0 tests. 2024-09-15T12:30:15.030 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-15T12:30:15.030 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-09-15T12:30:15.030 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-09-15T12:30:15.030 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestObjectMap.InvalidateFlagOnDisk 2024-09-15T12:30:15.030 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-09-15T12:30:15.030 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:30:15.031 INFO:tasks.workunit.client.0.smithi071.stdout: YOU HAVE 1 DISABLED TEST 2024-09-15T12:30:15.031 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:30:15.098 INFO:tasks.workunit.client.0.smithi071.stdout:seed 33350 2024-09-15T12:30:15.099 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = TestOperations.* 2024-09-15T12:30:15.099 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 1 test from 1 test suite. 2024-09-15T12:30:15.099 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:30:15.099 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 1 test from TestOperations 2024-09-15T12:30:17.039 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestOperations.DisableJournalingCorrupt 2024-09-15T12:30:19.151 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Operations.cc:18: Skipped 2024-09-15T12:30:19.151 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:19.151 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt (2112 ms) 2024-09-15T12:30:20.050 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 1 test from TestOperations (2112 ms total) 2024-09-15T12:30:20.051 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:30:20.051 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:30:20.051 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 1 test from 1 test suite ran. (4952 ms total) 2024-09-15T12:30:20.051 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 0 tests. 2024-09-15T12:30:20.051 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-15T12:30:20.051 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt 2024-09-15T12:30:20.114 INFO:tasks.workunit.client.0.smithi071.stdout:seed 33399 2024-09-15T12:30:20.115 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = TestTrash.* 2024-09-15T12:30:20.115 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-15T12:30:20.115 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:30:20.115 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 2 tests from TestTrash 2024-09-15T12:30:22.021 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestTrash.UserRemovingSource 2024-09-15T12:30:24.167 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Trash.cc:36: Skipped 2024-09-15T12:30:24.167 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:24.167 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestTrash.UserRemovingSource (2146 ms) 2024-09-15T12:30:24.167 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestTrash.RestoreMirroringSource 2024-09-15T12:30:24.212 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Trash.cc:93: Skipped 2024-09-15T12:30:24.212 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:24.212 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestTrash.RestoreMirroringSource (45 ms) 2024-09-15T12:30:25.075 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 2 tests from TestTrash (2191 ms total) 2024-09-15T12:30:25.075 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:30:25.076 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:30:25.076 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 2 tests from 1 test suite ran. (4960 ms total) 2024-09-15T12:30:25.076 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 0 tests. 2024-09-15T12:30:25.076 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-15T12:30:25.076 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestTrash.UserRemovingSource 2024-09-15T12:30:25.076 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestTrash.RestoreMirroringSource 2024-09-15T12:30:25.140 INFO:tasks.workunit.client.0.smithi071.stdout:seed 33448 2024-09-15T12:30:25.141 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = TestJournalEntries.* 2024-09-15T12:30:25.141 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-15T12:30:25.141 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:30:25.141 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 4 tests from TestJournalEntries 2024-09-15T12:30:27.084 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalEntries.AioWrite 2024-09-15T12:30:29.204 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:118: Skipped 2024-09-15T12:30:29.204 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:29.204 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalEntries.AioWrite (2120 ms) 2024-09-15T12:30:29.205 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalEntries.AioDiscard 2024-09-15T12:30:29.253 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:163: Skipped 2024-09-15T12:30:29.253 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:29.253 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard (49 ms) 2024-09-15T12:30:29.253 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalEntries.AioDiscardWithPrune 2024-09-15T12:30:29.304 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:200: Skipped 2024-09-15T12:30:29.304 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:29.304 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune (51 ms) 2024-09-15T12:30:29.304 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalEntries.AioFlush 2024-09-15T12:30:29.351 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:263: Skipped 2024-09-15T12:30:29.351 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:29.351 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalEntries.AioFlush (47 ms) 2024-09-15T12:30:30.098 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 4 tests from TestJournalEntries (2267 ms total) 2024-09-15T12:30:30.098 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:30:30.098 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:30:30.098 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 4 tests from 1 test suite ran. (4957 ms total) 2024-09-15T12:30:30.099 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 0 tests. 2024-09-15T12:30:30.099 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-15T12:30:30.099 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalEntries.AioWrite 2024-09-15T12:30:30.099 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard 2024-09-15T12:30:30.099 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune 2024-09-15T12:30:30.099 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalEntries.AioFlush 2024-09-15T12:30:30.183 INFO:tasks.workunit.client.0.smithi071.stdout:seed 33497 2024-09-15T12:30:30.184 INFO:tasks.workunit.client.0.smithi071.stdout:Note: Google Test filter = TestJournalReplay.* 2024-09-15T12:30:30.184 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 16 tests from 1 test suite. 2024-09-15T12:30:30.184 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-15T12:30:30.184 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 16 tests from TestJournalReplay 2024-09-15T12:30:32.021 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.AioDiscardEvent 2024-09-15T12:30:34.219 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:109: Skipped 2024-09-15T12:30:34.219 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.219 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent (2198 ms) 2024-09-15T12:30:34.219 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.AioWriteEvent 2024-09-15T12:30:34.267 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:200: Skipped 2024-09-15T12:30:34.267 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.267 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent (48 ms) 2024-09-15T12:30:34.267 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.AioFlushEvent 2024-09-15T12:30:34.314 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:261: Skipped 2024-09-15T12:30:34.314 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.314 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent (47 ms) 2024-09-15T12:30:34.314 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.SnapCreate 2024-09-15T12:30:34.363 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:307: Skipped 2024-09-15T12:30:34.363 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.363 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate (49 ms) 2024-09-15T12:30:34.364 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.SnapProtect 2024-09-15T12:30:34.411 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:348: Skipped 2024-09-15T12:30:34.411 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.411 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect (48 ms) 2024-09-15T12:30:34.411 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.SnapUnprotect 2024-09-15T12:30:34.459 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:394: Skipped 2024-09-15T12:30:34.459 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.459 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect (48 ms) 2024-09-15T12:30:34.459 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.SnapRename 2024-09-15T12:30:34.506 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:450: Skipped 2024-09-15T12:30:34.506 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.506 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.SnapRename (47 ms) 2024-09-15T12:30:34.506 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.SnapRollback 2024-09-15T12:30:34.552 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:500: Skipped 2024-09-15T12:30:34.552 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.552 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback (46 ms) 2024-09-15T12:30:34.552 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.SnapRemove 2024-09-15T12:30:34.598 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:541: Skipped 2024-09-15T12:30:34.598 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.598 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove (46 ms) 2024-09-15T12:30:34.598 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.Rename 2024-09-15T12:30:34.644 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:590: Skipped 2024-09-15T12:30:34.644 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.644 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.Rename (46 ms) 2024-09-15T12:30:34.644 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.Resize 2024-09-15T12:30:34.693 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:624: Skipped 2024-09-15T12:30:34.693 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.693 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.Resize (49 ms) 2024-09-15T12:30:34.693 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.Flatten 2024-09-15T12:30:34.748 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:657: Skipped 2024-09-15T12:30:34.748 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.748 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.Flatten (55 ms) 2024-09-15T12:30:34.748 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.UpdateFeatures 2024-09-15T12:30:34.795 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:704: Skipped 2024-09-15T12:30:34.795 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.795 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures (47 ms) 2024-09-15T12:30:34.795 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.MetadataSet 2024-09-15T12:30:34.843 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:741: Skipped 2024-09-15T12:30:34.843 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.843 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet (48 ms) 2024-09-15T12:30:34.843 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.MetadataRemove 2024-09-15T12:30:34.891 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:781: Skipped 2024-09-15T12:30:34.891 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.891 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove (48 ms) 2024-09-15T12:30:34.891 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestJournalReplay.ObjectPosition 2024-09-15T12:30:34.947 INFO:tasks.workunit.client.0.smithi071.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:824: Skipped 2024-09-15T12:30:34.947 INFO:tasks.workunit.client.0.smithi071.stdout:Skipping due to unmet REQUIRE 2024-09-15T12:30:34.947 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition (56 ms) 2024-09-15T12:30:35.125 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 16 tests from TestJournalReplay (2926 ms total) 2024-09-15T12:30:35.126 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-15T12:30:35.126 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-15T12:30:35.126 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 16 tests from 1 test suite ran. (4941 ms total) 2024-09-15T12:30:35.126 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 0 tests. 2024-09-15T12:30:35.126 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-15T12:30:35.126 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent 2024-09-15T12:30:35.126 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent 2024-09-15T12:30:35.126 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent 2024-09-15T12:30:35.126 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate 2024-09-15T12:30:35.126 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect 2024-09-15T12:30:35.126 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect 2024-09-15T12:30:35.126 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.SnapRename 2024-09-15T12:30:35.126 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback 2024-09-15T12:30:35.126 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove 2024-09-15T12:30:35.127 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.Rename 2024-09-15T12:30:35.127 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.Resize 2024-09-15T12:30:35.127 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.Flatten 2024-09-15T12:30:35.127 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures 2024-09-15T12:30:35.127 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet 2024-09-15T12:30:35.127 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove 2024-09-15T12:30:35.127 INFO:tasks.workunit.client.0.smithi071.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition 2024-09-15T12:30:35.131 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-15T12:30:35.131 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-15T12:30:35.163 INFO:tasks.workunit:Stopping ['rbd/crimson/test_crimson_librbd.sh'] on client.0... 2024-09-15T12:30:35.163 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-15T12:30:35.531 DEBUG:teuthology.parallel:result is None 2024-09-15T12:30:35.531 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T12:30:35.562 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T12:30:35.562 DEBUG:teuthology.orchestra.run.smithi071:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-15T12:30:35.624 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T12:30:35.624 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-15T12:30:35.638 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T12:30:35.638 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:30:35.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:35.784+0000 7fc779b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:35.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:35.792+0000 7fc779b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:35.984 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:30:35.984 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-15T12:30:35.997 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":615,"stamp":"2024-09-15T12:30:35.118872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":11464,"kb_used_data":11464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156881720,"statfs":{"total":160658620416,"available":160646881280,"internally_reserved":0,"allocated":11739136,"data_stored":11739136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.019922"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":501,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.642328+0000","last_change":"2024-09-15T12:16:44.732654+0000","last_active":"2024-09-15T12:30:08.642328+0000","last_peered":"2024-09-15T12:30:08.642328+0000","last_clean":"2024-09-15T12:30:08.642328+0000","last_became_active":"2024-09-15T12:16:42.803733+0000","last_became_peered":"2024-09-15T12:16:42.803733+0000","last_unstale":"2024-09-15T12:30:08.642328+0000","last_undegraded":"2024-09-15T12:30:08.642328+0000","last_fullsized":"2024-09-15T12:30:08.642328+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":501,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.659698+0000","last_change":"2024-09-15T12:16:44.737389+0000","last_active":"2024-09-15T12:30:08.659698+0000","last_peered":"2024-09-15T12:30:08.659698+0000","last_clean":"2024-09-15T12:30:08.659698+0000","last_became_active":"2024-09-15T12:16:42.870264+0000","last_became_peered":"2024-09-15T12:16:42.870264+0000","last_unstale":"2024-09-15T12:30:08.659698+0000","last_undegraded":"2024-09-15T12:30:08.659698+0000","last_fullsized":"2024-09-15T12:30:08.659698+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":501,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.647823+0000","last_change":"2024-09-15T12:16:44.733449+0000","last_active":"2024-09-15T12:30:08.647823+0000","last_peered":"2024-09-15T12:30:08.647823+0000","last_clean":"2024-09-15T12:30:08.647823+0000","last_became_active":"2024-09-15T12:16:42.826421+0000","last_became_peered":"2024-09-15T12:16:42.826421+0000","last_unstale":"2024-09-15T12:30:08.647823+0000","last_undegraded":"2024-09-15T12:30:08.647823+0000","last_fullsized":"2024-09-15T12:30:08.647823+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":501,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.651073+0000","last_change":"2024-09-15T12:16:44.733581+0000","last_active":"2024-09-15T12:30:08.651073+0000","last_peered":"2024-09-15T12:30:08.651073+0000","last_clean":"2024-09-15T12:30:08.651073+0000","last_became_active":"2024-09-15T12:16:42.813424+0000","last_became_peered":"2024-09-15T12:16:42.813424+0000","last_unstale":"2024-09-15T12:30:08.651073+0000","last_undegraded":"2024-09-15T12:30:08.651073+0000","last_fullsized":"2024-09-15T12:30:08.651073+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":506,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.697312+0000","last_change":"2024-09-15T12:16:44.737394+0000","last_active":"2024-09-15T12:30:09.697312+0000","last_peered":"2024-09-15T12:30:09.697312+0000","last_clean":"2024-09-15T12:30:09.697312+0000","last_became_active":"2024-09-15T12:16:42.877184+0000","last_became_peered":"2024-09-15T12:16:42.877184+0000","last_unstale":"2024-09-15T12:30:09.697312+0000","last_undegraded":"2024-09-15T12:30:09.697312+0000","last_fullsized":"2024-09-15T12:30:09.697312+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T12:30:13.061521+0000","last_change":"2024-09-15T12:16:44.736299+0000","last_active":"2024-09-15T12:30:13.061521+0000","last_peered":"2024-09-15T12:30:13.061521+0000","last_clean":"2024-09-15T12:30:13.061521+0000","last_became_active":"2024-09-15T12:16:42.859171+0000","last_became_peered":"2024-09-15T12:16:42.859171+0000","last_unstale":"2024-09-15T12:30:13.061521+0000","last_undegraded":"2024-09-15T12:30:13.061521+0000","last_fullsized":"2024-09-15T12:30:13.061521+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":516,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T12:30:13.043526+0000","last_change":"2024-09-15T12:16:44.731224+0000","last_active":"2024-09-15T12:30:13.043526+0000","last_peered":"2024-09-15T12:30:13.043526+0000","last_clean":"2024-09-15T12:30:13.043526+0000","last_became_active":"2024-09-15T12:16:42.822882+0000","last_became_peered":"2024-09-15T12:16:42.822882+0000","last_unstale":"2024-09-15T12:30:13.043526+0000","last_undegraded":"2024-09-15T12:30:13.043526+0000","last_fullsized":"2024-09-15T12:30:13.043526+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":502,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.655963+0000","last_change":"2024-09-15T12:16:44.737015+0000","last_active":"2024-09-15T12:30:08.655963+0000","last_peered":"2024-09-15T12:30:08.655963+0000","last_clean":"2024-09-15T12:30:08.655963+0000","last_became_active":"2024-09-15T12:16:42.824114+0000","last_became_peered":"2024-09-15T12:16:42.824114+0000","last_unstale":"2024-09-15T12:30:08.655963+0000","last_undegraded":"2024-09-15T12:30:08.655963+0000","last_fullsized":"2024-09-15T12:30:08.655963+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":570,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.662096+0000","last_change":"2024-09-15T12:16:41.767801+0000","last_active":"2024-09-15T12:30:08.662096+0000","last_peered":"2024-09-15T12:30:08.662096+0000","last_clean":"2024-09-15T12:30:08.662096+0000","last_became_active":"2024-09-15T12:16:41.746909+0000","last_became_peered":"2024-09-15T12:16:41.746909+0000","last_unstale":"2024-09-15T12:30:08.662096+0000","last_undegraded":"2024-09-15T12:30:08.662096+0000","last_fullsized":"2024-09-15T12:30:08.662096+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:40.676710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:40.676710+0000","last_clean_scrub_stamp":"2024-09-15T12:16:40.676710+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160646852608,"internally_reserved":0,"allocated":11767808,"data_stored":11767808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53548621824,"internally_reserved":0,"allocated":4251648,"data_stored":4251648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3156,"kb_used_data":3156,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294572,"statfs":{"total":53552873472,"available":53549641728,"internally_reserved":0,"allocated":3231744,"data_stored":3231744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739176,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4144,"kb_used_data":4144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293584,"statfs":{"total":53552873472,"available":53548630016,"internally_reserved":0,"allocated":4243456,"data_stored":4243456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4164,"kb_used_data":4164,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293564,"statfs":{"total":53552873472,"available":53548609536,"internally_reserved":0,"allocated":4263936,"data_stored":4263936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53548621824,"internally_reserved":0,"allocated":4251648,"data_stored":4251648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53548597248,"internally_reserved":0,"allocated":4276224,"data_stored":4276224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53548621824,"internally_reserved":0,"allocated":4251648,"data_stored":4251648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53549633536,"internally_reserved":0,"allocated":3239936,"data_stored":3239936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:30:35.998 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:30:36.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:36.101+0000 7f7b20791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:36.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:36.108+0000 7f7b20791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:36.291 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:30:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-15T12:30:36.304 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":615,"stamp":"2024-09-15T12:30:35.118872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":11464,"kb_used_data":11464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156881720,"statfs":{"total":160658620416,"available":160646881280,"internally_reserved":0,"allocated":11739136,"data_stored":11739136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.019922"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":501,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.642328+0000","last_change":"2024-09-15T12:16:44.732654+0000","last_active":"2024-09-15T12:30:08.642328+0000","last_peered":"2024-09-15T12:30:08.642328+0000","last_clean":"2024-09-15T12:30:08.642328+0000","last_became_active":"2024-09-15T12:16:42.803733+0000","last_became_peered":"2024-09-15T12:16:42.803733+0000","last_unstale":"2024-09-15T12:30:08.642328+0000","last_undegraded":"2024-09-15T12:30:08.642328+0000","last_fullsized":"2024-09-15T12:30:08.642328+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":501,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.659698+0000","last_change":"2024-09-15T12:16:44.737389+0000","last_active":"2024-09-15T12:30:08.659698+0000","last_peered":"2024-09-15T12:30:08.659698+0000","last_clean":"2024-09-15T12:30:08.659698+0000","last_became_active":"2024-09-15T12:16:42.870264+0000","last_became_peered":"2024-09-15T12:16:42.870264+0000","last_unstale":"2024-09-15T12:30:08.659698+0000","last_undegraded":"2024-09-15T12:30:08.659698+0000","last_fullsized":"2024-09-15T12:30:08.659698+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":501,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.647823+0000","last_change":"2024-09-15T12:16:44.733449+0000","last_active":"2024-09-15T12:30:08.647823+0000","last_peered":"2024-09-15T12:30:08.647823+0000","last_clean":"2024-09-15T12:30:08.647823+0000","last_became_active":"2024-09-15T12:16:42.826421+0000","last_became_peered":"2024-09-15T12:16:42.826421+0000","last_unstale":"2024-09-15T12:30:08.647823+0000","last_undegraded":"2024-09-15T12:30:08.647823+0000","last_fullsized":"2024-09-15T12:30:08.647823+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":501,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.651073+0000","last_change":"2024-09-15T12:16:44.733581+0000","last_active":"2024-09-15T12:30:08.651073+0000","last_peered":"2024-09-15T12:30:08.651073+0000","last_clean":"2024-09-15T12:30:08.651073+0000","last_became_active":"2024-09-15T12:16:42.813424+0000","last_became_peered":"2024-09-15T12:16:42.813424+0000","last_unstale":"2024-09-15T12:30:08.651073+0000","last_undegraded":"2024-09-15T12:30:08.651073+0000","last_fullsized":"2024-09-15T12:30:08.651073+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":506,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.697312+0000","last_change":"2024-09-15T12:16:44.737394+0000","last_active":"2024-09-15T12:30:09.697312+0000","last_peered":"2024-09-15T12:30:09.697312+0000","last_clean":"2024-09-15T12:30:09.697312+0000","last_became_active":"2024-09-15T12:16:42.877184+0000","last_became_peered":"2024-09-15T12:16:42.877184+0000","last_unstale":"2024-09-15T12:30:09.697312+0000","last_undegraded":"2024-09-15T12:30:09.697312+0000","last_fullsized":"2024-09-15T12:30:09.697312+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T12:30:13.061521+0000","last_change":"2024-09-15T12:16:44.736299+0000","last_active":"2024-09-15T12:30:13.061521+0000","last_peered":"2024-09-15T12:30:13.061521+0000","last_clean":"2024-09-15T12:30:13.061521+0000","last_became_active":"2024-09-15T12:16:42.859171+0000","last_became_peered":"2024-09-15T12:16:42.859171+0000","last_unstale":"2024-09-15T12:30:13.061521+0000","last_undegraded":"2024-09-15T12:30:13.061521+0000","last_fullsized":"2024-09-15T12:30:13.061521+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":516,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T12:30:13.043526+0000","last_change":"2024-09-15T12:16:44.731224+0000","last_active":"2024-09-15T12:30:13.043526+0000","last_peered":"2024-09-15T12:30:13.043526+0000","last_clean":"2024-09-15T12:30:13.043526+0000","last_became_active":"2024-09-15T12:16:42.822882+0000","last_became_peered":"2024-09-15T12:16:42.822882+0000","last_unstale":"2024-09-15T12:30:13.043526+0000","last_undegraded":"2024-09-15T12:30:13.043526+0000","last_fullsized":"2024-09-15T12:30:13.043526+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":502,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.655963+0000","last_change":"2024-09-15T12:16:44.737015+0000","last_active":"2024-09-15T12:30:08.655963+0000","last_peered":"2024-09-15T12:30:08.655963+0000","last_clean":"2024-09-15T12:30:08.655963+0000","last_became_active":"2024-09-15T12:16:42.824114+0000","last_became_peered":"2024-09-15T12:16:42.824114+0000","last_unstale":"2024-09-15T12:30:08.655963+0000","last_undegraded":"2024-09-15T12:30:08.655963+0000","last_fullsized":"2024-09-15T12:30:08.655963+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":570,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.662096+0000","last_change":"2024-09-15T12:16:41.767801+0000","last_active":"2024-09-15T12:30:08.662096+0000","last_peered":"2024-09-15T12:30:08.662096+0000","last_clean":"2024-09-15T12:30:08.662096+0000","last_became_active":"2024-09-15T12:16:41.746909+0000","last_became_peered":"2024-09-15T12:16:41.746909+0000","last_unstale":"2024-09-15T12:30:08.662096+0000","last_undegraded":"2024-09-15T12:30:08.662096+0000","last_fullsized":"2024-09-15T12:30:08.662096+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:40.676710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:40.676710+0000","last_clean_scrub_stamp":"2024-09-15T12:16:40.676710+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160646852608,"internally_reserved":0,"allocated":11767808,"data_stored":11767808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53548621824,"internally_reserved":0,"allocated":4251648,"data_stored":4251648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3156,"kb_used_data":3156,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294572,"statfs":{"total":53552873472,"available":53549641728,"internally_reserved":0,"allocated":3231744,"data_stored":3231744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739176,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4144,"kb_used_data":4144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293584,"statfs":{"total":53552873472,"available":53548630016,"internally_reserved":0,"allocated":4243456,"data_stored":4243456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4164,"kb_used_data":4164,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293564,"statfs":{"total":53552873472,"available":53548609536,"internally_reserved":0,"allocated":4263936,"data_stored":4263936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53548621824,"internally_reserved":0,"allocated":4251648,"data_stored":4251648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53548597248,"internally_reserved":0,"allocated":4276224,"data_stored":4276224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53548621824,"internally_reserved":0,"allocated":4251648,"data_stored":4251648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53549633536,"internally_reserved":0,"allocated":3239936,"data_stored":3239936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:30:36.305 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T12:30:36.305 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:30:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:36.407+0000 7f0dbf711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:36.415+0000 7f0dbf711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:36.598 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:30:36.599 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-15T12:30:36.611 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":615,"stamp":"2024-09-15T12:30:35.118872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":11464,"kb_used_data":11464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156881720,"statfs":{"total":160658620416,"available":160646881280,"internally_reserved":0,"allocated":11739136,"data_stored":11739136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.019922"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":501,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.642328+0000","last_change":"2024-09-15T12:16:44.732654+0000","last_active":"2024-09-15T12:30:08.642328+0000","last_peered":"2024-09-15T12:30:08.642328+0000","last_clean":"2024-09-15T12:30:08.642328+0000","last_became_active":"2024-09-15T12:16:42.803733+0000","last_became_peered":"2024-09-15T12:16:42.803733+0000","last_unstale":"2024-09-15T12:30:08.642328+0000","last_undegraded":"2024-09-15T12:30:08.642328+0000","last_fullsized":"2024-09-15T12:30:08.642328+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":501,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.659698+0000","last_change":"2024-09-15T12:16:44.737389+0000","last_active":"2024-09-15T12:30:08.659698+0000","last_peered":"2024-09-15T12:30:08.659698+0000","last_clean":"2024-09-15T12:30:08.659698+0000","last_became_active":"2024-09-15T12:16:42.870264+0000","last_became_peered":"2024-09-15T12:16:42.870264+0000","last_unstale":"2024-09-15T12:30:08.659698+0000","last_undegraded":"2024-09-15T12:30:08.659698+0000","last_fullsized":"2024-09-15T12:30:08.659698+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":501,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.647823+0000","last_change":"2024-09-15T12:16:44.733449+0000","last_active":"2024-09-15T12:30:08.647823+0000","last_peered":"2024-09-15T12:30:08.647823+0000","last_clean":"2024-09-15T12:30:08.647823+0000","last_became_active":"2024-09-15T12:16:42.826421+0000","last_became_peered":"2024-09-15T12:16:42.826421+0000","last_unstale":"2024-09-15T12:30:08.647823+0000","last_undegraded":"2024-09-15T12:30:08.647823+0000","last_fullsized":"2024-09-15T12:30:08.647823+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":501,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.651073+0000","last_change":"2024-09-15T12:16:44.733581+0000","last_active":"2024-09-15T12:30:08.651073+0000","last_peered":"2024-09-15T12:30:08.651073+0000","last_clean":"2024-09-15T12:30:08.651073+0000","last_became_active":"2024-09-15T12:16:42.813424+0000","last_became_peered":"2024-09-15T12:16:42.813424+0000","last_unstale":"2024-09-15T12:30:08.651073+0000","last_undegraded":"2024-09-15T12:30:08.651073+0000","last_fullsized":"2024-09-15T12:30:08.651073+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":506,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.697312+0000","last_change":"2024-09-15T12:16:44.737394+0000","last_active":"2024-09-15T12:30:09.697312+0000","last_peered":"2024-09-15T12:30:09.697312+0000","last_clean":"2024-09-15T12:30:09.697312+0000","last_became_active":"2024-09-15T12:16:42.877184+0000","last_became_peered":"2024-09-15T12:16:42.877184+0000","last_unstale":"2024-09-15T12:30:09.697312+0000","last_undegraded":"2024-09-15T12:30:09.697312+0000","last_fullsized":"2024-09-15T12:30:09.697312+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T12:30:13.061521+0000","last_change":"2024-09-15T12:16:44.736299+0000","last_active":"2024-09-15T12:30:13.061521+0000","last_peered":"2024-09-15T12:30:13.061521+0000","last_clean":"2024-09-15T12:30:13.061521+0000","last_became_active":"2024-09-15T12:16:42.859171+0000","last_became_peered":"2024-09-15T12:16:42.859171+0000","last_unstale":"2024-09-15T12:30:13.061521+0000","last_undegraded":"2024-09-15T12:30:13.061521+0000","last_fullsized":"2024-09-15T12:30:13.061521+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":516,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T12:30:13.043526+0000","last_change":"2024-09-15T12:16:44.731224+0000","last_active":"2024-09-15T12:30:13.043526+0000","last_peered":"2024-09-15T12:30:13.043526+0000","last_clean":"2024-09-15T12:30:13.043526+0000","last_became_active":"2024-09-15T12:16:42.822882+0000","last_became_peered":"2024-09-15T12:16:42.822882+0000","last_unstale":"2024-09-15T12:30:13.043526+0000","last_undegraded":"2024-09-15T12:30:13.043526+0000","last_fullsized":"2024-09-15T12:30:13.043526+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":502,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.655963+0000","last_change":"2024-09-15T12:16:44.737015+0000","last_active":"2024-09-15T12:30:08.655963+0000","last_peered":"2024-09-15T12:30:08.655963+0000","last_clean":"2024-09-15T12:30:08.655963+0000","last_became_active":"2024-09-15T12:16:42.824114+0000","last_became_peered":"2024-09-15T12:16:42.824114+0000","last_unstale":"2024-09-15T12:30:08.655963+0000","last_undegraded":"2024-09-15T12:30:08.655963+0000","last_fullsized":"2024-09-15T12:30:08.655963+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":570,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-15T12:30:08.662096+0000","last_change":"2024-09-15T12:16:41.767801+0000","last_active":"2024-09-15T12:30:08.662096+0000","last_peered":"2024-09-15T12:30:08.662096+0000","last_clean":"2024-09-15T12:30:08.662096+0000","last_became_active":"2024-09-15T12:16:41.746909+0000","last_became_peered":"2024-09-15T12:16:41.746909+0000","last_unstale":"2024-09-15T12:30:08.662096+0000","last_undegraded":"2024-09-15T12:30:08.662096+0000","last_fullsized":"2024-09-15T12:30:08.662096+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:40.676710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:40.676710+0000","last_clean_scrub_stamp":"2024-09-15T12:16:40.676710+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160646852608,"internally_reserved":0,"allocated":11767808,"data_stored":11767808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53548621824,"internally_reserved":0,"allocated":4251648,"data_stored":4251648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3156,"kb_used_data":3156,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294572,"statfs":{"total":53552873472,"available":53549641728,"internally_reserved":0,"allocated":3231744,"data_stored":3231744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739176,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4144,"kb_used_data":4144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293584,"statfs":{"total":53552873472,"available":53548630016,"internally_reserved":0,"allocated":4243456,"data_stored":4243456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4164,"kb_used_data":4164,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293564,"statfs":{"total":53552873472,"available":53548609536,"internally_reserved":0,"allocated":4263936,"data_stored":4263936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53548621824,"internally_reserved":0,"allocated":4251648,"data_stored":4251648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53548597248,"internally_reserved":0,"allocated":4276224,"data_stored":4276224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53548621824,"internally_reserved":0,"allocated":4251648,"data_stored":4251648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53549633536,"internally_reserved":0,"allocated":3239936,"data_stored":3239936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:30:36.612 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:30:36.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:36.714+0000 7f1d95991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:36.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:36.721+0000 7f1d95991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:36.913 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:30:36.913 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":203,"fsid":"15740f92-12c8-45c5-92c7-38ec03331077","created":"2024-09-15T12:16:31.911786+0000","modified":"2024-09-15T12:30:35.114945+0000","last_up_change":"2024-09-15T12:16:39.667128+0000","last_in_change":"2024-09-15T12:16:33.790814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:16:40.639465+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T12:16:41.660063+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3671ebe9-6279-457b-a77b-f8d2199c1af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":3492089919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3492089919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":3492089919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3492089919}]},"public_addr":"172.21.15.71:6807/3492089919","cluster_addr":"172.21.15.71:6806/3492089919","heartbeat_back_addr":"172.21.15.71:6813/3492089919","heartbeat_front_addr":"172.21.15.71:6814/3492089919","state":["exists","up"]},{"osd":1,"uuid":"59c182aa-1a80-4ae8-a9b5-0780af54aa23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":2928762362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2928762362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2928762362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":2928762362}]},"public_addr":"172.21.15.71:6803/2928762362","cluster_addr":"172.21.15.71:6802/2928762362","heartbeat_back_addr":"172.21.15.71:6804/2928762362","heartbeat_front_addr":"172.21.15.71:6805/2928762362","state":["exists","up"]},{"osd":2,"uuid":"46acd69a-3bb8-4e7d-b6c7-1797498de197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1014999051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":1014999051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1014999051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":1014999051}]},"public_addr":"172.21.15.71:6808/1014999051","cluster_addr":"172.21.15.71:6809/1014999051","heartbeat_back_addr":"172.21.15.71:6810/1014999051","heartbeat_front_addr":"172.21.15.71:6811/1014999051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":3,"snaps":[{"begin":2,"length":13},{"begin":17,"length":1},{"begin":21,"length":1},{"begin":24,"length":1},{"begin":28,"length":8}]},{"pool":4,"snaps":[{"begin":2,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1}]},{"pool":6,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":2,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":1}]},{"pool":20,"snaps":[{"begin":2,"length":4}]},{"pool":21,"snaps":[{"begin":2,"length":1}]},{"pool":22,"snaps":[{"begin":2,"length":1}]},{"pool":23,"snaps":[{"begin":2,"length":1}]},{"pool":24,"snaps":[{"begin":2,"length":1}]},{"pool":25,"snaps":[{"begin":2,"length":1}]},{"pool":26,"snaps":[{"begin":2,"length":1}]},{"pool":27,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:30:37.928 INFO:tasks.ceph:Scrubbing osd.0 2024-09-15T12:30:37.928 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-15T12:30:38.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:38.036+0000 7f0154afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:38.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:38.048+0000 7f0154afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:38.062 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-15T12:30:38.063 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "" 2024-09-15T12:30:38.063 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-15T12:30:38.074 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-15T12:30:38.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:38.176+0000 7f36efe57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:38.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:38.184+0000 7f36efe57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:38.370 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 0 to deep-scrub 2024-09-15T12:30:38.386 INFO:tasks.ceph:Scrubbing osd.1 2024-09-15T12:30:38.387 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-15T12:30:38.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:38.489+0000 7f56c0f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:38.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:38.501+0000 7f56c0f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:38.517 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-15T12:30:38.517 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "" 2024-09-15T12:30:38.517 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-15T12:30:38.528 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-15T12:30:38.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:38.630+0000 7f1979a7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:38.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:38.638+0000 7f1979a7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:38.823 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 1 to deep-scrub 2024-09-15T12:30:38.840 INFO:tasks.ceph:Scrubbing osd.2 2024-09-15T12:30:38.840 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-15T12:30:38.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:38.947+0000 7fbb47488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:38.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:38.959+0000 7fbb47488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:38.975 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-15T12:30:38.975 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "" 2024-09-15T12:30:38.975 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-15T12:30:38.986 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-15T12:30:39.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:39.087+0000 7f9bc84fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:39.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:39.095+0000 7f9bc84fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:39.282 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 2 to deep-scrub 2024-09-15T12:30:39.301 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:30:39.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:39.403+0000 7f0063e88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:39.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:39.410+0000 7f0063e88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:39.595 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:30:39.596 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-15T12:30:39.608 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":618,"stamp":"2024-09-15T12:30:38.793752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":10320,"kb_used_data":10320,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156882864,"statfs":{"total":160658620416,"available":160648052736,"internally_reserved":0,"allocated":10567680,"data_stored":10567680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.687879"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":585,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:37.043767+0000","last_change":"2024-09-15T12:16:44.732654+0000","last_active":"2024-09-15T12:30:37.043767+0000","last_peered":"2024-09-15T12:30:37.043767+0000","last_clean":"2024-09-15T12:30:37.043767+0000","last_became_active":"2024-09-15T12:16:42.803733+0000","last_became_peered":"2024-09-15T12:16:42.803733+0000","last_unstale":"2024-09-15T12:30:37.043767+0000","last_undegraded":"2024-09-15T12:30:37.043767+0000","last_fullsized":"2024-09-15T12:30:37.043767+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":585,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:37.049032+0000","last_change":"2024-09-15T12:16:44.737389+0000","last_active":"2024-09-15T12:30:37.049032+0000","last_peered":"2024-09-15T12:30:37.049032+0000","last_clean":"2024-09-15T12:30:37.049032+0000","last_became_active":"2024-09-15T12:16:42.870264+0000","last_became_peered":"2024-09-15T12:16:42.870264+0000","last_unstale":"2024-09-15T12:30:37.049032+0000","last_undegraded":"2024-09-15T12:30:37.049032+0000","last_fullsized":"2024-09-15T12:30:37.049032+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":585,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:37.044665+0000","last_change":"2024-09-15T12:16:44.733449+0000","last_active":"2024-09-15T12:30:37.044665+0000","last_peered":"2024-09-15T12:30:37.044665+0000","last_clean":"2024-09-15T12:30:37.044665+0000","last_became_active":"2024-09-15T12:16:42.826421+0000","last_became_peered":"2024-09-15T12:16:42.826421+0000","last_unstale":"2024-09-15T12:30:37.044665+0000","last_undegraded":"2024-09-15T12:30:37.044665+0000","last_fullsized":"2024-09-15T12:30:37.044665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":585,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:37.045586+0000","last_change":"2024-09-15T12:16:44.733581+0000","last_active":"2024-09-15T12:30:37.045586+0000","last_peered":"2024-09-15T12:30:37.045586+0000","last_clean":"2024-09-15T12:30:37.045586+0000","last_became_active":"2024-09-15T12:16:42.813424+0000","last_became_peered":"2024-09-15T12:16:42.813424+0000","last_unstale":"2024-09-15T12:30:37.045586+0000","last_undegraded":"2024-09-15T12:30:37.045586+0000","last_fullsized":"2024-09-15T12:30:37.045586+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":506,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.697312+0000","last_change":"2024-09-15T12:16:44.737394+0000","last_active":"2024-09-15T12:30:09.697312+0000","last_peered":"2024-09-15T12:30:09.697312+0000","last_clean":"2024-09-15T12:30:09.697312+0000","last_became_active":"2024-09-15T12:16:42.877184+0000","last_became_peered":"2024-09-15T12:16:42.877184+0000","last_unstale":"2024-09-15T12:30:09.697312+0000","last_undegraded":"2024-09-15T12:30:09.697312+0000","last_fullsized":"2024-09-15T12:30:09.697312+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T12:30:13.061521+0000","last_change":"2024-09-15T12:16:44.736299+0000","last_active":"2024-09-15T12:30:13.061521+0000","last_peered":"2024-09-15T12:30:13.061521+0000","last_clean":"2024-09-15T12:30:13.061521+0000","last_became_active":"2024-09-15T12:16:42.859171+0000","last_became_peered":"2024-09-15T12:16:42.859171+0000","last_unstale":"2024-09-15T12:30:13.061521+0000","last_undegraded":"2024-09-15T12:30:13.061521+0000","last_fullsized":"2024-09-15T12:30:13.061521+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":516,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T12:30:13.043526+0000","last_change":"2024-09-15T12:16:44.731224+0000","last_active":"2024-09-15T12:30:13.043526+0000","last_peered":"2024-09-15T12:30:13.043526+0000","last_clean":"2024-09-15T12:30:13.043526+0000","last_became_active":"2024-09-15T12:16:42.822882+0000","last_became_peered":"2024-09-15T12:16:42.822882+0000","last_unstale":"2024-09-15T12:30:13.043526+0000","last_undegraded":"2024-09-15T12:30:13.043526+0000","last_fullsized":"2024-09-15T12:30:13.043526+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":586,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:37.049929+0000","last_change":"2024-09-15T12:16:44.737015+0000","last_active":"2024-09-15T12:30:37.049929+0000","last_peered":"2024-09-15T12:30:37.049929+0000","last_clean":"2024-09-15T12:30:37.049929+0000","last_became_active":"2024-09-15T12:16:42.824114+0000","last_became_peered":"2024-09-15T12:16:42.824114+0000","last_unstale":"2024-09-15T12:30:37.049929+0000","last_undegraded":"2024-09-15T12:30:37.049929+0000","last_fullsized":"2024-09-15T12:30:37.049929+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":654,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:37.046676+0000","last_change":"2024-09-15T12:16:41.767801+0000","last_active":"2024-09-15T12:30:37.046676+0000","last_peered":"2024-09-15T12:30:37.046676+0000","last_clean":"2024-09-15T12:30:37.046676+0000","last_became_active":"2024-09-15T12:16:41.746909+0000","last_became_peered":"2024-09-15T12:16:41.746909+0000","last_unstale":"2024-09-15T12:30:37.046676+0000","last_undegraded":"2024-09-15T12:30:37.046676+0000","last_fullsized":"2024-09-15T12:30:37.046676+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:40.676710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:40.676710+0000","last_clean_scrub_stamp":"2024-09-15T12:16:40.676710+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160648032256,"internally_reserved":0,"allocated":10588160,"data_stored":10588160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53549801472,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3156,"kb_used_data":3156,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294572,"statfs":{"total":53552873472,"available":53549641728,"internally_reserved":0,"allocated":3231744,"data_stored":3231744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739206,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3000,"kb_used_data":3000,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294728,"statfs":{"total":53552873472,"available":53549801472,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4164,"kb_used_data":4164,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293564,"statfs":{"total":53552873472,"available":53548609536,"internally_reserved":0,"allocated":4263936,"data_stored":4263936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53549801472,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53548597248,"internally_reserved":0,"allocated":4276224,"data_stored":4276224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53549801472,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53549633536,"internally_reserved":0,"allocated":3239936,"data_stored":3239936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:30:39.612 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-15T12:16:41.682629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=16, tm_sec=41, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=30, tm_sec=36, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:30:39.612 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-15T12:16:41.682629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=16, tm_sec=41, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=30, tm_sec=36, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:30:39.612 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-15T12:16:41.682629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=16, tm_sec=41, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=30, tm_sec=36, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:30:39.612 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-15T12:16:41.682629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=16, tm_sec=41, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=30, tm_sec=36, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:30:39.612 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-15T12:16:41.682629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=16, tm_sec=41, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=30, tm_sec=36, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:30:39.613 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-15T12:16:41.682629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=16, tm_sec=41, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=30, tm_sec=36, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:30:39.613 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-15T12:16:41.682629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=16, tm_sec=41, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=30, tm_sec=36, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:30:39.613 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-15T12:16:41.682629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=16, tm_sec=41, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=30, tm_sec=36, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:30:39.613 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-15T12:16:40.676710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=16, tm_sec=40, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=30, tm_sec=36, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:30:39.613 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-15T12:30:59.614 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:30:59.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:59.729+0000 7fcb5c711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:59.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:30:59.736+0000 7fcb5c711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:59.922 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:30:59.923 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-15T12:30:59.935 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":628,"stamp":"2024-09-15T12:30:58.798221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":7628,"kb_used_data":7628,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156885556,"statfs":{"total":160658620416,"available":160650809344,"internally_reserved":0,"allocated":7811072,"data_stored":7811072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002732"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":585,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:37.043767+0000","last_change":"2024-09-15T12:16:44.732654+0000","last_active":"2024-09-15T12:30:37.043767+0000","last_peered":"2024-09-15T12:30:37.043767+0000","last_clean":"2024-09-15T12:30:37.043767+0000","last_became_active":"2024-09-15T12:16:42.803733+0000","last_became_peered":"2024-09-15T12:16:42.803733+0000","last_unstale":"2024-09-15T12:30:37.043767+0000","last_undegraded":"2024-09-15T12:30:37.043767+0000","last_fullsized":"2024-09-15T12:30:37.043767+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":585,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:37.049032+0000","last_change":"2024-09-15T12:16:44.737389+0000","last_active":"2024-09-15T12:30:37.049032+0000","last_peered":"2024-09-15T12:30:37.049032+0000","last_clean":"2024-09-15T12:30:37.049032+0000","last_became_active":"2024-09-15T12:16:42.870264+0000","last_became_peered":"2024-09-15T12:16:42.870264+0000","last_unstale":"2024-09-15T12:30:37.049032+0000","last_undegraded":"2024-09-15T12:30:37.049032+0000","last_fullsized":"2024-09-15T12:30:37.049032+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":585,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:37.044665+0000","last_change":"2024-09-15T12:16:44.733449+0000","last_active":"2024-09-15T12:30:37.044665+0000","last_peered":"2024-09-15T12:30:37.044665+0000","last_clean":"2024-09-15T12:30:37.044665+0000","last_became_active":"2024-09-15T12:16:42.826421+0000","last_became_peered":"2024-09-15T12:16:42.826421+0000","last_unstale":"2024-09-15T12:30:37.044665+0000","last_undegraded":"2024-09-15T12:30:37.044665+0000","last_fullsized":"2024-09-15T12:30:37.044665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":585,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:37.045586+0000","last_change":"2024-09-15T12:16:44.733581+0000","last_active":"2024-09-15T12:30:37.045586+0000","last_peered":"2024-09-15T12:30:37.045586+0000","last_clean":"2024-09-15T12:30:37.045586+0000","last_became_active":"2024-09-15T12:16:42.813424+0000","last_became_peered":"2024-09-15T12:16:42.813424+0000","last_unstale":"2024-09-15T12:30:37.045586+0000","last_undegraded":"2024-09-15T12:30:37.045586+0000","last_fullsized":"2024-09-15T12:30:37.045586+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":589,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:38.371882+0000","last_change":"2024-09-15T12:30:38.390532+0000","last_active":"2024-09-15T12:30:38.371882+0000","last_peered":"2024-09-15T12:30:38.371882+0000","last_clean":"2024-09-15T12:30:38.371882+0000","last_became_active":"2024-09-15T12:16:42.877184+0000","last_became_peered":"2024-09-15T12:16:42.877184+0000","last_unstale":"2024-09-15T12:30:38.371882+0000","last_undegraded":"2024-09-15T12:30:38.371882+0000","last_fullsized":"2024-09-15T12:30:38.371882+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2024-09-15T12:30:38.390358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:30:38.390358+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":587,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:39.284725+0000","last_change":"2024-09-15T12:30:39.297379+0000","last_active":"2024-09-15T12:30:39.284725+0000","last_peered":"2024-09-15T12:30:39.284725+0000","last_clean":"2024-09-15T12:30:39.284725+0000","last_became_active":"2024-09-15T12:16:42.859171+0000","last_became_peered":"2024-09-15T12:16:42.859171+0000","last_unstale":"2024-09-15T12:30:39.284725+0000","last_undegraded":"2024-09-15T12:30:39.284725+0000","last_fullsized":"2024-09-15T12:30:39.284725+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:30:39.297113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:30:39.297113+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":587,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:39.282460+0000","last_change":"2024-09-15T12:30:39.295132+0000","last_active":"2024-09-15T12:30:39.282460+0000","last_peered":"2024-09-15T12:30:39.282460+0000","last_clean":"2024-09-15T12:30:39.282460+0000","last_became_active":"2024-09-15T12:16:42.822882+0000","last_became_peered":"2024-09-15T12:16:42.822882+0000","last_unstale":"2024-09-15T12:30:39.282460+0000","last_undegraded":"2024-09-15T12:30:39.282460+0000","last_fullsized":"2024-09-15T12:30:39.282460+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:30:39.294967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:30:39.294967+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":586,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:37.049929+0000","last_change":"2024-09-15T12:16:44.737015+0000","last_active":"2024-09-15T12:30:37.049929+0000","last_peered":"2024-09-15T12:30:37.049929+0000","last_clean":"2024-09-15T12:30:37.049929+0000","last_became_active":"2024-09-15T12:16:42.824114+0000","last_became_peered":"2024-09-15T12:16:42.824114+0000","last_unstale":"2024-09-15T12:30:37.049929+0000","last_undegraded":"2024-09-15T12:30:37.049929+0000","last_fullsized":"2024-09-15T12:30:37.049929+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:41.682629+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":654,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:37.046676+0000","last_change":"2024-09-15T12:16:41.767801+0000","last_active":"2024-09-15T12:30:37.046676+0000","last_peered":"2024-09-15T12:30:37.046676+0000","last_clean":"2024-09-15T12:30:37.046676+0000","last_became_active":"2024-09-15T12:16:41.746909+0000","last_became_peered":"2024-09-15T12:16:41.746909+0000","last_unstale":"2024-09-15T12:30:37.046676+0000","last_undegraded":"2024-09-15T12:30:37.046676+0000","last_fullsized":"2024-09-15T12:30:37.046676+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:16:40.676710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:16:40.676710+0000","last_clean_scrub_stamp":"2024-09-15T12:16:40.676710+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160650809344,"internally_reserved":0,"allocated":7811072,"data_stored":7811072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53549801472,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1868,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295860,"statfs":{"total":53552873472,"available":53550960640,"internally_reserved":0,"allocated":1912832,"data_stored":1912832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739206,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3000,"kb_used_data":3000,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294728,"statfs":{"total":53552873472,"available":53549801472,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2760,"kb_used_data":2760,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294968,"statfs":{"total":53552873472,"available":53550047232,"internally_reserved":0,"allocated":2826240,"data_stored":2826240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53549801472,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550047232,"internally_reserved":0,"allocated":2826240,"data_stored":2826240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53549801472,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550960640,"internally_reserved":0,"allocated":1912832,"data_stored":1912832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:30:59.936 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-15T12:16:41.682629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=16, tm_sec=41, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=30, tm_sec=36, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:30:59.936 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-15T12:16:41.682629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=16, tm_sec=41, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=30, tm_sec=36, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:30:59.936 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-15T12:16:41.682629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=16, tm_sec=41, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=30, tm_sec=36, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:30:59.937 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-15T12:16:41.682629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=16, tm_sec=41, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=30, tm_sec=36, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:30:59.937 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-15T12:16:41.682629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=16, tm_sec=41, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=30, tm_sec=36, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:30:59.937 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-15T12:16:40.676710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=16, tm_sec=40, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=30, tm_sec=36, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:30:59.937 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-15T12:31:19.938 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:31:20.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:31:20.052+0000 7f9fe0ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:20.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:31:20.060+0000 7f9fe0ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:20.252 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-15T12:31:20.252 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-15T12:31:20.265 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":638,"stamp":"2024-09-15T12:31:18.803464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":156893184,"kb_used":7628,"kb_used_data":7628,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":156885556,"statfs":{"total":160658620416,"available":160650809344,"internally_reserved":0,"allocated":7811072,"data_stored":7811072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003389"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":587,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:38.829153+0000","last_change":"2024-09-15T12:30:38.864985+0000","last_active":"2024-09-15T12:30:38.829153+0000","last_peered":"2024-09-15T12:30:38.829153+0000","last_clean":"2024-09-15T12:30:38.829153+0000","last_became_active":"2024-09-15T12:16:42.803733+0000","last_became_peered":"2024-09-15T12:16:42.803733+0000","last_unstale":"2024-09-15T12:30:38.829153+0000","last_undegraded":"2024-09-15T12:30:38.829153+0000","last_fullsized":"2024-09-15T12:30:38.829153+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:30:38.864771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:30:38.864771+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":587,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:38.830977+0000","last_change":"2024-09-15T12:30:38.861686+0000","last_active":"2024-09-15T12:30:38.830977+0000","last_peered":"2024-09-15T12:30:38.830977+0000","last_clean":"2024-09-15T12:30:38.830977+0000","last_became_active":"2024-09-15T12:16:42.870264+0000","last_became_peered":"2024-09-15T12:16:42.870264+0000","last_unstale":"2024-09-15T12:30:38.830977+0000","last_undegraded":"2024-09-15T12:30:38.830977+0000","last_fullsized":"2024-09-15T12:30:38.830977+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:30:38.861519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:30:38.861519+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":587,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:38.827735+0000","last_change":"2024-09-15T12:30:38.867933+0000","last_active":"2024-09-15T12:30:38.827735+0000","last_peered":"2024-09-15T12:30:38.827735+0000","last_clean":"2024-09-15T12:30:38.827735+0000","last_became_active":"2024-09-15T12:16:42.826421+0000","last_became_peered":"2024-09-15T12:16:42.826421+0000","last_unstale":"2024-09-15T12:30:38.827735+0000","last_undegraded":"2024-09-15T12:30:38.827735+0000","last_fullsized":"2024-09-15T12:30:38.827735+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:30:38.867752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:30:38.867752+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":587,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:38.826517+0000","last_change":"2024-09-15T12:30:38.871152+0000","last_active":"2024-09-15T12:30:38.826517+0000","last_peered":"2024-09-15T12:30:38.826517+0000","last_clean":"2024-09-15T12:30:38.826517+0000","last_became_active":"2024-09-15T12:16:42.813424+0000","last_became_peered":"2024-09-15T12:16:42.813424+0000","last_unstale":"2024-09-15T12:30:38.826517+0000","last_undegraded":"2024-09-15T12:30:38.826517+0000","last_fullsized":"2024-09-15T12:30:38.826517+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:30:38.870973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:30:38.870973+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":589,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:38.371882+0000","last_change":"2024-09-15T12:30:38.390532+0000","last_active":"2024-09-15T12:30:38.371882+0000","last_peered":"2024-09-15T12:30:38.371882+0000","last_clean":"2024-09-15T12:30:38.371882+0000","last_became_active":"2024-09-15T12:16:42.877184+0000","last_became_peered":"2024-09-15T12:16:42.877184+0000","last_unstale":"2024-09-15T12:30:38.371882+0000","last_undegraded":"2024-09-15T12:30:38.371882+0000","last_fullsized":"2024-09-15T12:30:38.371882+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2024-09-15T12:30:38.390358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:30:38.390358+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":587,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:39.284725+0000","last_change":"2024-09-15T12:30:39.297379+0000","last_active":"2024-09-15T12:30:39.284725+0000","last_peered":"2024-09-15T12:30:39.284725+0000","last_clean":"2024-09-15T12:30:39.284725+0000","last_became_active":"2024-09-15T12:16:42.859171+0000","last_became_peered":"2024-09-15T12:16:42.859171+0000","last_unstale":"2024-09-15T12:30:39.284725+0000","last_undegraded":"2024-09-15T12:30:39.284725+0000","last_fullsized":"2024-09-15T12:30:39.284725+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:30:39.297113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:30:39.297113+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":587,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:39.282460+0000","last_change":"2024-09-15T12:30:39.295132+0000","last_active":"2024-09-15T12:30:39.282460+0000","last_peered":"2024-09-15T12:30:39.282460+0000","last_clean":"2024-09-15T12:30:39.282460+0000","last_became_active":"2024-09-15T12:16:42.822882+0000","last_became_peered":"2024-09-15T12:16:42.822882+0000","last_unstale":"2024-09-15T12:30:39.282460+0000","last_undegraded":"2024-09-15T12:30:39.282460+0000","last_fullsized":"2024-09-15T12:30:39.282460+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:30:39.294967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:30:39.294967+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":588,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:38.826356+0000","last_change":"2024-09-15T12:30:38.857873+0000","last_active":"2024-09-15T12:30:38.826356+0000","last_peered":"2024-09-15T12:30:38.826356+0000","last_clean":"2024-09-15T12:30:38.826356+0000","last_became_active":"2024-09-15T12:16:42.824114+0000","last_became_peered":"2024-09-15T12:16:42.824114+0000","last_unstale":"2024-09-15T12:30:38.826356+0000","last_undegraded":"2024-09-15T12:30:38.826356+0000","last_fullsized":"2024-09-15T12:30:38.826356+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'1","last_scrub_stamp":"2024-09-15T12:30:38.857675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:30:38.857675+0000","last_clean_scrub_stamp":"2024-09-15T12:16:41.682629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":656,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T12:30:38.824610+0000","last_change":"2024-09-15T12:30:38.884052+0000","last_active":"2024-09-15T12:30:38.824610+0000","last_peered":"2024-09-15T12:30:38.824610+0000","last_clean":"2024-09-15T12:30:38.824610+0000","last_became_active":"2024-09-15T12:16:41.746909+0000","last_became_peered":"2024-09-15T12:16:41.746909+0000","last_unstale":"2024-09-15T12:30:38.824610+0000","last_undegraded":"2024-09-15T12:30:38.824610+0000","last_fullsized":"2024-09-15T12:30:38.824610+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'52","last_scrub_stamp":"2024-09-15T12:30:38.883836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:30:38.883836+0000","last_clean_scrub_stamp":"2024-09-15T12:16:40.676710+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160650809344,"internally_reserved":0,"allocated":7811072,"data_stored":7811072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53549801472,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706531,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1868,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295860,"statfs":{"total":53552873472,"available":53550960640,"internally_reserved":0,"allocated":1912832,"data_stored":1912832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739236,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3000,"kb_used_data":3000,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294728,"statfs":{"total":53552873472,"available":53549801472,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706526,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2760,"kb_used_data":2760,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294968,"statfs":{"total":53552873472,"available":53550047232,"internally_reserved":0,"allocated":2826240,"data_stored":2826240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53549801472,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550047232,"internally_reserved":0,"allocated":2826240,"data_stored":2826240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53549801472,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550960640,"internally_reserved":0,"allocated":1912832,"data_stored":1912832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:31:20.266 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-15T12:31:20.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:31:20.368+0000 7f049e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:20.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-15T12:31:20.379+0000 7f049e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:20.593 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-15T12:31:20.594 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-15T12:31:20.594 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-15T12:31:20.594 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:31:20.673 INFO:tasks.ceph.osd.0:Stopped 2024-09-15T12:31:20.674 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-15T12:31:20.674 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:31:25.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-15T12:31:26.775 INFO:tasks.ceph.osd.1:Stopped 2024-09-15T12:31:26.776 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-15T12:31:26.776 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:31:26.857 INFO:tasks.ceph.osd.2:Stopped 2024-09-15T12:31:26.857 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-15T12:31:26.857 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-15T12:31:26.857 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:31:26.888 INFO:tasks.ceph.mgr.x:Stopped 2024-09-15T12:31:26.888 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-15T12:31:26.889 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-15T12:31:26.889 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:31:26.943 INFO:tasks.ceph.mon.a:Stopped 2024-09-15T12:31:26.943 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-15T12:31:26.943 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'is full \(reached quota' | egrep -v '\(POOL_FULL\)' | head -n 1 2024-09-15T12:31:27.028 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-15T12:31:27.028 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-15T12:31:27.172 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-15T12:31:27.172 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-15T12:31:27.271 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-15T12:31:27.271 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-15T12:31:27.335 INFO:tasks.ceph:Archiving mon data... 2024-09-15T12:31:27.336 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905501/data/mon.a.tgz 2024-09-15T12:31:27.337 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-09-15T12:31:27.352 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.DxPUk5oWBw 2024-09-15T12:31:27.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.DxPUk5oWBw 2024-09-15T12:31:27.483 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.DxPUk5oWBw 2024-09-15T12:31:27.566 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.DxPUk5oWBw is 264KB 2024-09-15T12:31:27.661 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.DxPUk5oWBw 2024-09-15T12:31:27.676 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-15T12:31:27.676 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T12:31:27.795 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T12:31:27.795 INFO:tasks.ceph:Archiving crash dumps... 2024-09-15T12:31:27.797 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905501/remote/smithi071/crash 2024-09-15T12:31:27.798 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T12:31:27.859 INFO:tasks.ceph:Compressing logs... 2024-09-15T12:31:27.859 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T12:31:27.923 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-15T12:31:27.924 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32465.log 2024-09-15T12:31:27.938 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34056.log 2024-09-15T12:31:27.939 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.32465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33249.log 2024-09-15T12:31:27.939 INFO:teuthology.orchestra.run.smithi071.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.32465.log.gz 2024-09-15T12:31:27.939 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33720.log 2024-09-15T12:31:27.939 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34056.log.gz 2024-09-15T12:31:27.939 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33249.log: 76.5% -- replaced with /var/log/ceph/ceph-client.admin.33249.log.gz 2024-09-15T12:31:27.939 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-15T12:31:27.939 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32145.log 2024-09-15T12:31:27.939 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33720.log.gz 2024-09-15T12:31:27.939 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32273.log 2024-09-15T12:31:27.939 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33846.log 2024-09-15T12:31:27.939 INFO:teuthology.orchestra.run.smithi071.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.32145.log.gz 2024-09-15T12:31:27.939 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32695.log 2024-09-15T12:31:27.939 INFO:teuthology.orchestra.run.smithi071.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.32273.log.gz 2024-09-15T12:31:27.939 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28773.log 2024-09-15T12:31:27.940 INFO:teuthology.orchestra.run.smithi071.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33846.log.gz 2024-09-15T12:31:27.940 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34098.log 2024-09-15T12:31:27.940 INFO:teuthology.orchestra.run.smithi071.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.32695.log.gz 2024-09-15T12:31:27.940 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28773.log: gzip -5 50.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.28773.log.gz 2024-09-15T12:31:27.940 INFO:teuthology.orchestra.run.smithi071.stderr: /var/log/ceph/ceph-client.admin.32337.log 2024-09-15T12:31:27.940 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28923.log 2024-09-15T12:31:27.940 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34098.log.gz 2024-09-15T12:31:27.940 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32337.log: gzip -5 82.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.32337.log.gz 2024-09-15T12:31:27.940 INFO:teuthology.orchestra.run.smithi071.stderr: /var/log/ceph/ceph-client.admin.33636.log 2024-09-15T12:31:27.940 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33804.log 2024-09-15T12:31:27.940 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28923.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28923.log.gz 2024-09-15T12:31:27.940 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33399.log 2024-09-15T12:31:27.940 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33636.log.gz 2024-09-15T12:31:27.940 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33762.log 2024-09-15T12:31:27.941 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33804.log.gz 2024-09-15T12:31:27.941 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32209.log 2024-09-15T12:31:27.941 INFO:teuthology.orchestra.run.smithi071.stderr: 76.9% -- replaced with /var/log/ceph/ceph-client.admin.33399.log.gz 2024-09-15T12:31:27.941 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29746.log 2024-09-15T12:31:27.941 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33762.log.gz 2024-09-15T12:31:27.941 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28973.log 2024-09-15T12:31:27.941 INFO:teuthology.orchestra.run.smithi071.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.32209.log.gz 2024-09-15T12:31:27.941 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29658.log 2024-09-15T12:31:27.941 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29746.log.gz 2024-09-15T12:31:27.941 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28973.log: gzip -5 --verbose 50.4% -- -- replaced with /var/log/ceph/ceph-client.admin.28973.log.gz /var/log/ceph/ceph.audit.log 2024-09-15T12:31:27.941 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-15T12:31:27.941 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32643.log 2024-09-15T12:31:27.941 INFO:teuthology.orchestra.run.smithi071.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29658.log.gz 2024-09-15T12:31:27.941 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29914.log 2024-09-15T12:31:27.941 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29132.log 2024-09-15T12:31:27.942 INFO:teuthology.orchestra.run.smithi071.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32643.log.gz 2024-09-15T12:31:27.942 INFO:teuthology.orchestra.run.smithi071.stderr: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T12:31:27.942 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32401.log 2024-09-15T12:31:27.942 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29914.log.gz 2024-09-15T12:31:27.942 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29660.log 2024-09-15T12:31:27.942 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29132.log.gz 2024-09-15T12:31:27.942 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29578.log 2024-09-15T12:31:27.942 INFO:teuthology.orchestra.run.smithi071.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.32401.log.gz 2024-09-15T12:31:27.942 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33448.log 2024-09-15T12:31:27.942 INFO:teuthology.orchestra.run.smithi071.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29660.log.gz 2024-09-15T12:31:27.942 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33497.log 2024-09-15T12:31:27.942 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29578.log.gz 2024-09-15T12:31:27.942 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33448.log: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.33448.log.gz 2024-09-15T12:31:27.942 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28685.log 2024-09-15T12:31:27.943 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29659.log 2024-09-15T12:31:27.943 INFO:teuthology.orchestra.run.smithi071.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.33497.log.gz 2024-09-15T12:31:27.943 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29301.log 2024-09-15T12:31:27.943 INFO:teuthology.orchestra.run.smithi071.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28685.log.gz 2024-09-15T12:31:27.943 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29956.log 2024-09-15T12:31:27.943 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29659.log.gz 2024-09-15T12:31:27.943 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34181.log 2024-09-15T12:31:27.943 INFO:teuthology.orchestra.run.smithi071.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29301.log.gz 2024-09-15T12:31:27.943 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29956.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.29785.log 2024-09-15T12:31:27.943 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29956.log.gz 2024-09-15T12:31:27.943 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29536.log 2024-09-15T12:31:27.944 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34181.log.gz 2024-09-15T12:31:27.944 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29382.log 2024-09-15T12:31:27.944 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29785.log.gz 2024-09-15T12:31:27.944 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32530.log 2024-09-15T12:31:27.944 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29536.log.gz 2024-09-15T12:31:27.944 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29382.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-15T12:31:27.944 INFO:teuthology.orchestra.run.smithi071.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.29382.log.gz 2024-09-15T12:31:27.944 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29494.log 2024-09-15T12:31:27.944 INFO:teuthology.orchestra.run.smithi071.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.32530.log.gz 2024-09-15T12:31:27.944 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32594.log 2024-09-15T12:31:27.944 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33678.log 2024-09-15T12:31:27.944 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29494.log.gz 2024-09-15T12:31:27.944 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33972.log 2024-09-15T12:31:27.944 INFO:teuthology.orchestra.run.smithi071.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.32594.log.gz 2024-09-15T12:31:27.945 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33678.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-15T12:31:27.945 INFO:teuthology.orchestra.run.smithi071.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33678.log.gz 2024-09-15T12:31:27.945 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33972.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27724.log 2024-09-15T12:31:27.945 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33972.log.gz 2024-09-15T12:31:27.945 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29452.log 2024-09-15T12:31:27.945 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.tmp-client.admin.27724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33930.log 2024-09-15T12:31:27.945 INFO:teuthology.orchestra.run.smithi071.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27724.log.gz 2024-09-15T12:31:27.945 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29452.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T12:31:27.945 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29452.log.gz 2024-09-15T12:31:27.945 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33200.log 2024-09-15T12:31:27.945 INFO:teuthology.orchestra.run.smithi071.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33930.log.gz 2024-09-15T12:31:27.945 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29786.log 2024-09-15T12:31:27.952 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33200.log: gzip -5 --verbose -- 83.2% -- replaced with /var/log/ceph/ceph-client.admin.33200.log.gz 2024-09-15T12:31:27.953 INFO:teuthology.orchestra.run.smithi071.stderr: /var/log/ceph/ceph-client.admin.32081.log 2024-09-15T12:31:27.953 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29786.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29786.log.gz 2024-09-15T12:31:27.953 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34014.log 2024-09-15T12:31:27.953 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32081.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 82.3% -- replaced with /var/log/ceph/ceph-client.admin.32081.log.gz 2024-09-15T12:31:27.953 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-15T12:31:27.953 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34014.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33301.log 2024-09-15T12:31:27.953 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34014.log.gz 2024-09-15T12:31:27.953 INFO:teuthology.orchestra.run.smithi071.stderr: 88.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T12:31:27.953 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28883.log 2024-09-15T12:31:27.953 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34140.log 78.2% -- replaced with /var/log/ceph/ceph-client.admin.33301.log.gz 2024-09-15T12:31:27.953 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-15T12:31:27.953 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28883.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28883.log.gz 2024-09-15T12:31:27.953 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33888.log 2024-09-15T12:31:27.953 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34140.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34140.log.gz 2024-09-15T12:31:27.954 INFO:teuthology.orchestra.run.smithi071.stderr: -- /var/log/ceph/ceph-client.admin.29872.log 2024-09-15T12:31:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33888.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.33888.log.gz 2024-09-15T12:31:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33350.log 2024-09-15T12:31:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29872.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29872.log.gz 2024-09-15T12:31:27.954 INFO:teuthology.orchestra.run.smithi071.stderr: --verbose -- /var/log/ceph/ceph-client.admin.29162.log 2024-09-15T12:31:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33350.log: gzip 75.9% -- replaced with /var/log/ceph/ceph-client.admin.33350.log.gz 2024-09-15T12:31:27.954 INFO:teuthology.orchestra.run.smithi071.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30174.log 2024-09-15T12:31:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29162.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29162.log.gz 2024-09-15T12:31:27.954 INFO:teuthology.orchestra.run.smithi071.stderr: -- /var/log/ceph/ceph-client.admin.29357.log 2024-09-15T12:31:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30174.log: /var/log/ceph/ceph-client.admin.29357.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29357.log.gz 2024-09-15T12:31:27.954 INFO:teuthology.orchestra.run.smithi071.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.30174.log.gz 2024-09-15T12:31:28.024 INFO:teuthology.orchestra.run.smithi071.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-15T12:31:28.263 INFO:teuthology.orchestra.run.smithi071.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-15T12:31:30.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-15T12:31:31.285 INFO:teuthology.orchestra.run.smithi071.stderr: 96.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-15T12:31:31.610 INFO:teuthology.orchestra.run.smithi071.stderr: 96.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-15T12:31:33.191 INFO:teuthology.orchestra.run.smithi071.stderr: 96.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-15T12:31:33.193 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-15T12:31:33.193 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m5.279s 2024-09-15T12:31:33.193 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m12.153s 2024-09-15T12:31:33.193 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m0.601s 2024-09-15T12:31:33.194 INFO:tasks.ceph:Archiving logs... 2024-09-15T12:31:33.194 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905501/remote/smithi071/log 2024-09-15T12:31:33.195 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T12:31:34.581 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T12:31:34.590 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T12:31:34.590 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T12:31:34.649 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T12:31:34.657 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T12:31:34.657 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T12:31:34.678 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-15T12:31:34.682 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T12:31:34.682 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-15T12:31:34.682 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 58 +538us[ +536us] +/- 39ms 2024-09-15T12:31:34.682 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv02.front.sepia.ceph.com 3 6 377 57 -743us[ -745us] +/- 51ms 2024-09-15T12:31:34.682 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 +160us[ +158us] +/- 73ms 2024-09-15T12:31:34.683 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:31:34.683 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T12:31:34.691 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T12:31:34.691 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T12:31:34.699 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T12:31:34.782 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T12:31:34.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:31:34.809 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T12:31:34.817 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T12:31:34.833 INFO:teuthology.task.internal:Duration was 1340.903308 seconds 2024-09-15T12:31:34.834 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T12:31:34.843 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T12:31:34.843 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T12:31:34.890 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T12:31:35.276 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T12:31:35.277 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-09-15T12:31:35.277 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T12:31:35.338 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T12:31:35.338 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T12:31:35.404 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T12:31:35.404 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T12:31:35.544 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T12:31:35.553 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T12:31:35.554 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T12:31:35.578 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T12:31:35.587 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T12:31:35.642 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-09-15T12:31:35.655 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T12:31:35.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:31:35.709 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T12:31:35.719 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T12:31:35.719 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905501/remote/smithi071 2024-09-15T12:31:35.719 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T12:31:35.782 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T12:31:35.782 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T12:31:35.833 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T12:31:35.843 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T12:31:35.843 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T12:31:35.852 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T12:31:35.852 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T12:31:35.888 INFO:teuthology.orchestra.run.smithi071.stdout: 266061 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 12:31 /home/ubuntu/cephtest 2024-09-15T12:31:35.889 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T12:31:35.898 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T12:31:35.919 INFO:teuthology.run:Summary data: description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rbd_api_tests_old_format} duration: 1340.9033076763153 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-15T12:31:35.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T12:31:35.992 INFO:teuthology.run:pass